Senior Manager, Engineering - AI Validation (AI)

Location: Sunnyvale, California, United States; hybrid office work arrangement

Salary: $240,000–$290,000 USD base salary per year

Company

hirify.global develops AI-enabled software-defined vehicle and cloud technologies used by automotive OEMs, with products deployed in more than 8 million vehicles.

What you will do

• Define and drive AI validation strategy across embedded, in-vehicle, cloud-connected, and cloud-native AI systems.
• Lead, hire, mentor, and grow the AI Validation organization while establishing scalable engineering processes and technical direction.
• Own end-to-end validation for AI/ML models, LLMs, RAG pipelines, and agentic AI workflows from data pipelines and training through deployment.
• Architect evaluation frameworks and benchmarking platforms using deterministic metrics, LLM-as-a-Judge methods, automated regression testing, and production feedback loops.
• Build evaluation harnesses measuring retrieval quality, grounding, citation accuracy, factual consistency, safety, latency, reliability, and execution correctness.
• Act as the quality gatekeeper for AI-enabled releases and partner with engineering, product, safety, and OEM stakeholders on risk and production readiness.

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field; an MS is preferred.
• 10+ years of software or systems engineering experience, including 3+ years leading engineering or QA organizations.
• Hands-on experience developing, deploying, testing, or operating AI/ML systems, with expertise in modern ML workflows, neural networks, and MLOps.
• Deep knowledge of LLMs, RAG architectures, vector databases, embeddings, retrieval optimization, and agentic AI orchestration such as LangGraph.
• Experience designing scalable AI evaluation frameworks, regression testing, benchmarking, LLM-as-a-Judge methods, RAGAS, hallucination detection, grounding, citation verification, and factual consistency testing.
• Proficiency in Python, Linux, shell scripting, PyTest, Playwright, Behave, Jenkins, and JIRA, plus experience validating cloud-native and cloud-managed embedded platforms.

Nice to have

• AI validation experience in safety-critical or regulated industries such as automotive, aerospace, or medical technology.
• Experience building and scaling AI test, evaluation, or developer-experience platforms used by multiple teams.
• Experience standardizing organization-wide AI testing practices with measurable improvements in cycle time, quality, or reliability.
• Experience implementing enterprise-grade AI governance, auditability, monitoring, and policy enforcement.

Culture & Benefits

• Hybrid work arrangement based around the Sunnyvale headquarters.
• Medical, dental, and vision healthcare plans.
• Flexible and dependent care expense program, life insurance, and a 401(k) retirement plan.
• Unlimited paid time off and 14+ paid holidays.
• Wellness allowance, phone and internet reimbursement, computer accessory allowance, and complimentary food during onsite working days.