aiproduct managementmetricscybersecurityregression testingstartupsimulationevaluationagentic systems
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
$161к-225к/год
$200к$230кмедиана$250к
По похожим ролям (49) ~ $230к/год
На СНГ рынке: $4.7к/мес ($3.6к - $6.3к)
86
Хорошая вакансия
развернуть
У роли понятный фокус на оценке агентного ИИ, но работа в молодой оборонной компании и обязательный офис делают перспективы менее предсказуемыми и зависящими от локации.
Кликните для подробной информации
Только офисТолько для граждан СШАНа переднем крае ИИСильные инвесторыПонятная зона ответственностиОборонная киберсфера
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Staff Product Manager (AI): Building evaluation capabilities for agentic AI systems, including measures of agent performance, product quality, reliability, and task success with an accent on product requirements, evaluation workflows, and evidence-based decision-making. Focus on operationalizing agent evaluations, analyzing results and feedback, and improving autonomous systems through close partnership with engineering and AI teams.
Location: On-site in Arlington, VA or New York, NY. U.S. citizenship required; no active security clearance required.
Base salary: $161K–$225K per year. Estimated total compensation: $245K–$389K, including target bonus and estimated equity value.
Company
hirify.global industrializes offensive cyber operations for the U.S. and its allies using AI-enabled technology for mission-critical cyber operations.
What you will do
Own or support the product roadmap for agentic AI evaluations and translate product goals into priorities and outcomes.
Partner with engineering and AI teams to understand evaluation needs, technical constraints, and user workflows.
Define measures for agent performance and product quality, including task success, reliability, and quality.
Translate technical evaluation needs into product requirements, workflows, and acceptance criteria.
Operationalize evaluation workflows and success metrics for consistent assessment of agent behavior and product changes.
Use evaluation results and feedback to identify gaps, inform product decisions, and improve the agent experience.
Requirements
Strong product experience with AI or agentic systems, including building or managing agentic systems through product work.
Experience directly building evaluations for agents or building evaluation products, tooling, or systems used to assess them.
Ability to translate technical evaluation needs into product requirements, priorities, and workflows with engineering and AI teams.
Ability to define or operationalize meaningful measures of agent performance and product quality.
Strong communication, collaboration, and product judgment in an evolving, technically complex environment.
Product-minded, technically curious approach to understanding and improving agentic systems.
U.S. citizenship is required.
Nice to have
Experience in cybersecurity, offensive cyber, government, defense, intelligence, or another mission-driven environment.
Familiarity with benchmarks, human or automated evaluation, regression testing, simulation, or analysis of agent traces.
Experience with products that combine autonomous systems with meaningful human judgment and oversight.
Culture & Benefits
On-site, full-time work environment with close collaboration across product, engineering, and AI teams.
Medical, dental, and vision plan options, plus life, AD&D, and disability coverage options.
Paid parental leave for eligible full-time employees, with different provisions for birthing, non-birthing, adoptive, foster, and intended parents through surrogacy.
Paid holidays and flexible PTO.
401(k) with pre-tax and Roth options, plus HSA/FSA and dependent care FSA options.
Hiring process
Role scope is calibrated through the interview process.
Full benefits and compensation plan details are provided during the interview and offer process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →