обновлено 4 дня назад
Senior Manager, AI Performance & Operations
110 000 - 172 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Manager, AI Performance & Operations (LLM/Agentic AI): Owns production performance and continuous improvement for high-volume voice and text AI workflows with an accent on monitoring, evaluation, incident response, and safe optimization. Focus on diagnosing model, prompt, retrieval, tool, and orchestration failures, designing scalable evaluation systems, and driving measurable improvements through controlled launches and rollbacks.
Location: Remote USA
Salary: $110,000–$172,000 per year
Company
is a healthcare company combining health insurance, clinical care, service, and technology to improve the health and well-being of older Americans.
What you will do
- Own the health and production performance of major voice and text AI workflows.
- Maintain portfolio oversight of workflow status, maturity, failure modes, and next actions.
- Monitor containment, escalation, complaints, and production dashboards.
- Lead AI regression response, root-cause diagnosis, and post-mortems.
- Run controlled improvement cycles for model swaps, prompt changes, retrieval redesigns, and tool updates.
- Design scalable evaluations and guide early-stage workflows toward safe general availability launches.
Requirements
- Strong production experience with LLMs, RAG, voice AI, agentic orchestration, or equivalent ML systems.
- Experience designing or operating rubrics, scoring frameworks, regression tests, and production-sampling workflows.
- Ability to distinguish model reasoning, tool, retrieval, and workflow-logic failures.
- Experience with experimentation, prompt and context tuning, retrieval redesign, and safe model migrations.
- Strong cross-functional judgment, communication skills, and personal accountability for outcomes.
Nice to have
- Experience in healthcare, regulated workflows, contact center operations, or high-stakes service quality and reliability.
Culture & Benefits
- Employer-sponsored health, dental, and vision plans with low or no premium.
- Generous paid time off and a parental leave program.
- $100 monthly mobile or internet stipend.
- Stock options for all employees.
- Bonus eligibility for roles below Director level and a 401(k) program.
- Full-time employment with a diverse, collaborative, and supportive workplace.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
AI Strategist (Healthcare)
150 000 - 250 000$
5 дней назад
Senior AI Applied Engineer
141 100 - 194 000$
5 дней назад
Lead AI Applied Engineer (Healthcare)
170 800 - 234 800$
3 дня назад
Senior Principal, AI Software Engineer – Agentic & Industry Solutions
205 200 - 360 800$
2 дня назад
AI Innovation Specialist (AI)
60 000 - 95 000$
5 дней назад
Senior AI Engineer Software Engineer Government Technology (Agentic AI)
192 640 - 264 880$