Senior AI Product Manager, Leaderboard

TL;DR

Senior AI Product Manager, Leaderboard (AI evaluation): Owning and scaling evaluation products, benchmarks, and public and private leaderboards with an accent on product strategy, benchmark governance, infrastructure, and customer adoption. Focus on designing trustworthy measurement frameworks, coordinating cross-functional delivery, and turning frontier model evaluations into industry standards and scalable business opportunities.

Company

Scale AI develops data products and full-stack technologies that help leading organizations build, deploy, and oversee reliable AI systems.

What you will do

• Own the strategy and roadmap for the SEAL Leaderboard portfolio, including benchmark development, launches, infrastructure, and product expansion.
• Coordinate the Leaderboard Steering Committee and align AI product management, ML research, engineering, operations, and go-to-market stakeholders.
• Manage the complete leaderboard lifecycle from ideation and benchmark design through launch, growth, maintenance, and sunset decisions.
• Partner with researchers and domain experts to develop evaluation methodologies, benchmark specifications, scoring frameworks, and governance processes.
• Work with frontier AI labs and enterprise customers to identify evaluation needs, gather feedback, and guide future investments.
• Track adoption, customer impact, and business outcomes while identifying new evaluation categories, benchmark opportunities, and revenue-generating products.

Requirements

• 5+ years of experience in product management, technical program management, consulting, or customer-facing technical roles.
• Technical fluency in machine learning systems, AI model evaluation, benchmarking, or data products.
• Experience building and scaling products across engineering, operations, and business teams.
• Strong stakeholder management, executive communication, analytical, and product strategy skills.
• Ability to operate effectively in fast-moving, ambiguous environments and create new products or initiatives from the ground up.
• Passion for trustworthy AI evaluation and defining standards for measuring frontier model capabilities.

Nice to have

• Experience working with AI researchers, ML teams, or evaluation frameworks.
• Entrepreneurial experience launching new products, programs, or business initiatives.

Culture & Benefits

• Inclusive and equal opportunity workplace.
• Comprehensive health, dental, and vision coverage.
• Retirement benefits, learning and development stipend, and generous paid time off.
• Equity compensation may be available for eligible roles.
• Additional benefits such as a commuter stipend may apply.