Technical Program Manager, Quality (AI)

TL;DR

Technical Program Manager, Quality (AI): Managing the end-to-end lifecycle of LLM projects, bridging the gap between research and user-ready voice-based personal agents with an accent on transforming user feedback into technical evaluation datasets. Focus on implementing technical evaluations and ensuring models evolve based on measurable data.

Location: San Francisco, Bellevue

Salary: $200K – $260K

Company

hirify.global is designing a new kind of computer, focused on making voice companions part of our daily lives.

What you will do

• Manage the end-to-end lifecycle of LLM projects from research to production.
• Transform user feedback into objective metrics and datasets.
• Design and implement technical evaluations to address issues found in the field.
• Track internal and external feedback, ensuring identified issues are resolved.
• Maintain the technical roadmap for voice-based capabilities.
• Ensure the roadmap incorporates the specialized work and constraints of all teams to deliver a cohesive user experience.

Requirements

• BS or MS in Computer Science, Electrical Engineering, or a related technical discipline.
• 3+ years of experience managing LLM research or AI/ML product cycles.
• A solid technical understanding of LLMs and the unique constraints of voice-based interfaces.
• Proficiency in Python with the ability to write and implement evaluation logic and data-handling scripts.
• Proven ability to coordinate and align with stakeholders across different functions, managing complex dependencies.

Nice to have

• Prior experience with LLM-based voice products and modern generative speech technologies.
• Experience integrating model evaluation workflows into automated testing and deployment pipelines.
• Familiarity with the architectural challenges of deploying low-latency, conversational AI agents.

Culture & Benefits

• 100% employer-paid health, vision, and dental benefits.
• Flexible spending account matching (medical FSA).
• Unlimited PTO and sick time.
• 401k matching.
• Committed to a workplace where everyone feels valued, respected, and empowered.
• Provide reasonable accommodations for applicants with disabilities.