Technical Program Manager, Human Evaluation Operations (AI)

TL;DR

Technical Program Manager, Human Evaluation Operations (AI): Leading human evaluation programs for AI model quality and safety, coordinating workflows across product squads, engineering, and research. Focus on operational excellence in human-in-the-loop pipelines, ensuring reliable evaluation signals and driving improvements to internal tools and documentation.

Location: Must be based in Redmond, United States

Salary: USD $100,600 – $215,400 per year.

Company

hirify.global AI (MAI) is building the world’s most advanced AI systems—and rigorous, scalable human evaluation is foundational to ensuring our models are safe, aligned, and high‑quality.

What you will do

• Lead end‑to‑end human evaluation workflows supporting model quality, safety, and capability initiatives.
• Oversee the performance and scalability of MAI’s human evaluation workforce.
• Maintain high operational standards across human‑in‑the‑loop pipelines by monitoring quality signals and resolving issues.
• Partner with product squads to scope evaluation needs, define instructions, and support experimentation.
• Represent MAI needs to platform and vendor partners, shaping their roadmaps and ensuring compliance.
• Provide evaluation insights to product teams and influence the evolution of internal tools.

Requirements

• Bachelor’s Degree AND 2+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience.
• 1+ year(s) of experience managing cross-functional and/or cross-team projects.

Nice to have

• 3+ years of technical program management, operations management, data operations, or equivalent experience
• 1+ year(s) of experience reading and/or writing code.
• Experience working cross‑functionally with engineering, research, PM, vendors, and operations partners.
• Strong analytical skills and comfort working with dashboards, metrics, and evaluation data.
• Familiarity with LLM and AI model evaluation practices, data annotation platforms and systems.

Culture & Benefits

• hirify.global is an equal opportunity employer.