Quality Manager (AI)

Company

hirify.global is a leading AI company transforming global communication through machine translation and human-in-the-loop expertise, backed by Sequoia and Intel Capital.

What you will do

• Design and operate end-to-end quality frameworks for Applied AI deliverables.
• Build and maintain quality infrastructure to track metrics like defect rates, throughput, and SLA adherence.
• Manage rater and annotator operations, including calibration, retraining, and fraud detection.
• Partner with engineering and research teams to implement quality instrumentation and automated validations.
• Analyze customer quality disputes and drive process improvements to reduce recurring defect classes.
• Ensure all deliverables meet rigorous quality standards before shipping through documented sign-off processes.

Requirements

• Location: Must be based in or able to work from Boston, MA; New York, NY; or Washington D.C.
• 6+ years of experience building or operating quality programs for ML/LLM systems.
• Strong grasp of reliability and agreement methods (e.g., Krippendorff’s α, Cohen’s κ) and statistical analysis.
• Proven ability to design quality rubrics, sampling plans, and QC gates across concurrent programs.
• Hands-on experience with labeling/evaluation tooling and data governance.
• Excellent communication skills for stakeholder management and negotiating quality tradeoffs.

Culture & Benefits

• Opportunity to work at a category-defining company in the AI translation space.
• Access to leading tools and global collaboration opportunities.
• Commitment to a fair, inclusive, and transparent hiring process.
• Focus on professional growth and high-impact work.