21 час назад
Product Manager for Agent Intelligence (AI)
150 000 - 185 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Product Manager for Agent Intelligence (AI): Building evaluation, monitoring, and feedback systems that turn conversational agent interactions into structured insights and product improvements with an accent on quality standards, human-in-the-loop review, automated evaluation, and conversational data analysis. Focus on defining agent performance metrics, detecting failure patterns, designing scenario-based tests, and improving retrieval, ranking, personalization, and learning loops.
Location: Hybrid
Salary: $150,000–$185,000 annually, plus equity
Company
is an early-stage healthcare startup building an AI-powered care navigation platform for health systems and healthcare organizations.
What you will do
- Own the roadmap for the agent intelligence layer that measures, explains, and improves agent performance.
- Create evaluation rubrics and scoring standards for correctness, completeness, workflow adherence, customer experience, and outcomes.
- Build human-in-the-loop review workflows, automated evaluation pipelines, and scenario-based testing.
- Analyze, cluster, and explore large volumes of conversational data to identify failures, edge cases, and workflow gaps.
- Convert interaction failures into test scenarios, product requirements, training examples, and improvement opportunities.
- Partner with product, engineering, design, operations, and customer teams to improve retrieval, ranking, personalization, feedback systems, and agent outcomes.
Requirements
- Experience as a Product Manager working on technical, data-intensive, AI, automation, or platform products.
- Strong analytical skills and comfort with data, metrics, ambiguous problem spaces, and quality measurement.
- Experience defining quality standards, measurement frameworks, evaluation processes, or operational workflows.
- Ability to turn unstructured information into clear product direction and drive strategy through execution.
- Strong written and verbal communication skills and experience collaborating closely with engineering and cross-functional teams.
Nice to have
- Experience with AI products, conversational interfaces, LLMs, machine learning workflows, or agent systems.
- Experience with evaluation frameworks, experimentation, quality operations, or human-in-the-loop systems.
- Familiarity with retrieval, ranking, personalization, feedback loops, or data labeling workflows.
- Experience with large-scale conversational, support, call, or customer interaction data.
- Experience in healthcare, senior care, care operations, regulated environments, or 0-to-1 startup products.
Culture & Benefits
- Hybrid work environment.
- Equity offered as part of compensation.
- Values include service, safety, evidence, transparency, curiosity, kindness, collaboration, and thoughtful use of AI.
- Work focuses on improving the safety, reliability, accuracy, and effectiveness of AI-powered care navigation.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
22 часа назад
Product Manager, AI
140 000 - 180 000$
2 дня назад
Principal Product Manager (AI)
190 000 - 210 000$
2 дня назад
Senior Product Manager (AI)
160 000 - 190 000$
6 дней назад
Product Manager — PriorAuth (AI/Healthcare)
110 000 - 130 000$
2 дня назад
Forward Deployed Product Manager (AI)
155 000 - 195 000$
3 дня назад
Product Manager (Healthcare AI)
230 000 - 280 000$