AI Product Analyst (Voice AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
AI Product Analyst (Voice AI): Evaluating, monitoring, and improving Voice AI agents that automate patient journeys in a mental healthcare platform with an accent on AI behavior analysis and quality frameworks. Focus on investigating hallucinations, building performance dashboards, and translating AI production evidence into product decisions.
Location: Fully remote. Ability to work CET-overlapping hours required.
Company
AI-powered mental healthcare platform focused on providing accessible, affordable, and stigma-free psychiatric care in the United States.
What you will do
- Analyze production behavior and conversational workflows of Voice AI Agents.
- Investigate AI hallucinations, inconsistencies, and quality degradation using call transcripts and logs.
- Design evaluation frameworks to measure AI reliability, quality, and business impact.
- Build monitoring systems and dashboards for real-time AI performance visibility.
- Partner with Product, Engineering, and QA teams to refine AI initiatives.
- Detect quality shifts, anomalies, and emerging failure modes in production environments.
Requirements
- 3+ years of experience in Product, Data, or Operational Analytics within complex systems.
- Strong proficiency in SQL and Python for analytical investigations of large text datasets.
- Understanding of LLM limitations, hallucinations, prompt sensitivity, and AI failure modes.
- Experience building monitoring systems and operational dashboards.
- Fluent Russian and English level B2 or higher.
- Ability to work CET-overlapping hours.
Nice to have
- Experience with conversational AI or AI agents.
- Experience evaluating LLM outputs and using AI quality metrics.
- Knowledge of prompt iteration and AI evaluation frameworks.
- Experience working with ML pipelines or AI-powered products.
Culture & Benefits
- Remote-first environment with long-term B2B collaboration.
- Health insurance after the probation period and sports/wellness compensation.
- 19 working days of vacation per year, plus 3 wellness days and paid sick leave.
- Career development including personalized English lessons via Preply.
- Thoughtful gifts for important life events.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →