AI Quality Assurance Program Manager

Location: Hybrid position requiring work in the London office 2–3 days per week or month, as stated in the posting

Company

hirify.global connects travelers with experiences, accommodations, restaurants, and other travel services through content, technology, and two-sided marketplaces.

What you will do

• Define an end-to-end AI-era quality strategy spanning human and AI agents.
• Design evaluation benchmarks, testing protocols, and human-in-the-loop workflows for AI agents, support bots, and recommendation engines.
• Audit AI-generated support chats, tour recommendations, booking updates, and other traveler interactions for intent fulfillment, safety, tone, and hallucination prevention.
• Analyze QA evaluation data, model accuracy rates, and error trends to produce executive-ready reports, dashboards, and recommendations.
• Partner with Data Science, AI Engineering, Product, and Customer Experience teams on prompt refinements, model fine-tuning, and knowledge base improvements.
• Track AI deployment timelines, manage QA regression testing, and enforce quality standards before traveler rollouts.

Requirements

• 4–6 years of experience in technical program management, QA management, or AI/ML product operations focused on system reliability and evaluation.
• Strong knowledge of AI and LLM testing methodologies, prompt evaluation, intent recognition accuracy, and AI safety guardrails.
• Experience analyzing AI logs, using analytics tools, and presenting quality metrics to business leaders.
• Proven ability to bridge AI engineering teams, business stakeholders, and traveler support operations.
• Strong interest in online travel, traveler behavior, and trust in consumer-facing AI interactions.

Nice to have

• Experience with LLM evaluation tools, annotation platforms, or customer service AI tools such as Zendesk AI, Intercom, or Salesforce.
• Background in travel technology, e-commerce marketplaces, or fast-scaling consumer platforms.

Culture & Benefits

• Flexible, remote-friendly collaboration across a worldwide team, with on-site work available as required by the team.
• Flexible scheduling designed to support work-life balance.
• Competitive compensation with base salary and annual bonuses.
• Health benefits, employee assistance resources, tuition assistance, lifestyle benefits, and travel perks.
• Annual donation matching and referral awards.
• Culture focused on traveler value, fast execution, data-driven improvement, collaboration, and inclusion.