AI Product Analyst (AI)

AI Product Analyst - AI Receptionist Team | MEDvidi

#job #vacancy #AI #ProductAnalytics #LLM #AIagents #DataAnalytics #Startup #remote #MEDvidi #telehealth

MEDvidi is a fast-growing US telehealth company building AI-powered systems across patient and operational workflows.

We’re looking for an AI Product Analyst to help us evaluate, monitor, and improve AI agents and LLM-powered workflows running in production.

This role is focused on understanding how AI systems actually behave in real environments - identifying failure patterns, measuring AI quality, and helping teams make product decisions under ambiguity.

What you’ll work on:

- Analytics for AI agents and LLM-powered workflows
- Investigation of hallucinations, inconsistencies, and AI failure modes
- Analysis of logs, conversations, raw outputs, and operational datasets
- AI quality evaluation and monitoring
- Building dashboards and monitoring systems for AI performance
- Measuring AI impact on product, operations, and user experience
- Partnership with Product, Engineering, QA, and Operations teams

What we expect:

- 3+ years in Product / Data / AI Analytics
- Strong Python and SQL skills
- Understanding of LLM limitations, hallucinations, and AI evaluation challenges
- Experience with complex production systems or automation platforms
- Strong analytical and ownership mindset
- Experience with conversational AI or AI agents is a plus
- Fluent Russian and English B2+
- CET-overlapping working hours

Why join MEDvidi:

- Work on real AI systems in production
- High ownership and direct product impact
- Fast-moving startup environment
- Fully remote long-term B2B collaboration
- Health insurance, wellness compensation, paid vacation & sick leave
- Personalized English lessons via Preply

Apply here: Показать контакты