QA Lead (AI)

TL;DR

QA Lead (AI): Architecting and overseeing end-to-end quality strategies for AI Agent product lines with an accent on non-deterministic LLM testing, RAG logic, and conversational flows. Focus on building scalable automated evaluation frameworks, driving deployment excellence, and leading a team of QA analysts to ensure high-fidelity customer experiences.

Location: Must be based in the United States (Remote)

Company

hirify.global is a Stanford AI-backed platform that combines AI and human intelligence to optimize contact center operations and customer service automation.

What you will do

• Architect and oversee end-to-end evaluation systems for testing AI agent reliability, policy adherence, and logic.
• Leverage LLM-driven methodologies including automated simulations and adversarial red-teaming.
• Partner with engineering and product teams to triage deployment issues and build scalable testing frameworks.
• Conduct manual UAT and call testing to represent the voice of the customer.
• Lead and scale a pod of QA analysts, defining best practices and shared knowledge bases.

Requirements

• 5+ years of experience in Quality Engineering or Technical QA in high-growth SaaS or AI environments.
• Strong technical intuition regarding LLM architectures, RAG, and multi-turn conversational flows.
• Proven ability to lead large technical E2E projects and drive cross-functional efficiency.
• Excellent ability to identify edge cases and translate human empathy into technical testing requirements.
• Must be legally authorized to work in the United States.
• Startup agility with a bias toward action and building from ambiguity.

Nice to have

• Experience with CCaaS, telephony, or STT/TTS technologies.
• Background in Conversation Design or SDET roles.
• Prior experience leading teams with direct reports.

Culture & Benefits

• Comprehensive medical, dental, and vision coverage.
• Flexible PTO policy.
• Paid parental leave.
• Retirement savings plan.
• Remote work setup and monthly wellness stipends.