Director, Research - Evaluation & Training (AI)

TL;DR

Director, Research - Evaluation & Training (AI): Leading a research team focused on data evaluation, error analysis, and data valuation to predict and improve model performance with an accent on the data design flywheel and benchmarking. Focus on translating technical research findings into strategic data investments and business outcomes.

Location: Hybrid in San Francisco, CA

Salary: $275,000 - $425,000 USD

Company

Snorkel AI helps enterprises transform expert knowledge into specialized AI at scale by focusing on the quality of data used to build AI systems.

What you will do

• Own a multi-quarter roadmap centered on novel evaluation, error analysis, and data valuation techniques.
• Synthesize trends from model-failure analysis and benchmarking into strategic recommendations for dataset investments.
• Develop data valuation techniques to quantify how specific data meaningfully improves model performance.
• Lead and grow a team of researchers, maintaining a high bar for quality, rigor, and execution speed.
• Act as the primary bridge between the research team's findings and Product, GTM, and customers.

Requirements

• 7+ years in applied AI, ML, or research roles.
• 4+ years of experience managing technical teams.
• Strong business and market judgment within the AI/ML and frontier-lab landscape.
• Technical depth in LLM evaluation, benchmarking, and model behavior analysis.
• Excellent communication and storytelling skills for non-research audiences.
• Must be based in or able to work hybrid in San Francisco, CA.

Nice to have

• Familiarity with data valuation or data attribution research.
• Experience working with frontier labs, public benchmarks, or commercial AI data/eval products.

Culture & Benefits

• Combination of stability and high growth within a rapidly scaling, well-funded company.
• Meaningful opportunities to shape strategic priorities and influence key decisions.
• Strong support for career growth and learning across multiple functions.
• Commitment to diversity, equity, and equal employment opportunities.