Назад
Company hidden
обновлено 4 дня назад

Senior Manager, AI Performance & Operations

110 000 - 172 000$
Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Manager, AI Performance & Operations (LLM/Agentic AI): Owns production performance and continuous improvement for high-volume voice and text AI workflows with an accent on monitoring, evaluation, incident response, and safe optimization. Focus on diagnosing model, prompt, retrieval, tool, and orchestration failures, designing scalable evaluation systems, and driving measurable improvements through controlled launches and rollbacks.

Location: Remote USA

Salary: $110,000–$172,000 per year

Company

hirify.global is a healthcare company combining health insurance, clinical care, service, and technology to improve the health and well-being of older Americans.

What you will do

  • Own the health and production performance of major voice and text AI workflows.
  • Maintain portfolio oversight of workflow status, maturity, failure modes, and next actions.
  • Monitor containment, escalation, complaints, and production dashboards.
  • Lead AI regression response, root-cause diagnosis, and post-mortems.
  • Run controlled improvement cycles for model swaps, prompt changes, retrieval redesigns, and tool updates.
  • Design scalable evaluations and guide early-stage workflows toward safe general availability launches.

Requirements

  • Strong production experience with LLMs, RAG, voice AI, agentic orchestration, or equivalent ML systems.
  • Experience designing or operating rubrics, scoring frameworks, regression tests, and production-sampling workflows.
  • Ability to distinguish model reasoning, tool, retrieval, and workflow-logic failures.
  • Experience with experimentation, prompt and context tuning, retrieval redesign, and safe model migrations.
  • Strong cross-functional judgment, communication skills, and personal accountability for outcomes.

Nice to have

  • Experience in healthcare, regulated workflows, contact center operations, or high-stakes service quality and reliability.

Culture & Benefits

  • Employer-sponsored health, dental, and vision plans with low or no premium.
  • Generous paid time off and a parental leave program.
  • $100 monthly mobile or internet stipend.
  • Stock options for all employees.
  • Bonus eligibility for roles below Director level and a 401(k) program.
  • Full-time employment with a diverse, collaborative, and supportive workplace.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →