TL;DR

Group Product Manager (AI): Architecting and defining "Response Quality" standards for the Gemini App, focusing on user intent and model tuning for critical user cohorts. Focus on developing evaluation frameworks, steering model outputs through SFT/RLHF, and scaling sophisticated human-in-the-loop and LLM-as-a-judge evaluation pipelines.

Location: Onsite in Mountain View, California, US.

Salary: $227,000 - $320,000 + bonus + equity + benefits.

Company

%hirify_global% is a team of scientists, engineers, and machine learning experts working to advance artificial intelligence for public benefit and scientific discovery, prioritizing safety and ethics.

What you will do

Define and maintain North Star metrics for Response Quality across text, code, and multimodal modalities.
Identify needs of Critical User Cohorts, analyze performance gaps, and prioritize model tuning.
Ensure a frictionless, accurate, and delightful experience for the most vital user journeys.
Partner with Research and Data Operations to steer model outputs through SFT (Supervised Fine-Tuning) and RLHF.
Design and scale sophisticated human-in-the-loop and "LLM-as-a-judge" evaluation pipelines.

Requirements

6+ years of progressive product management experience, including at least 5 years in senior roles leading consumer products.
Track record of building consumer products with millions of users.
Experience with AI or ML-powered products and a perspective on how AI will change consumer software.
Comfort with ambiguity and the ability to define product direction in a fast-moving, novel space.
User-obsessed mindset with a habit of talking to users directly and frequently.

Nice to have

Expertise in User Psychology to articulate why a response feels "right" or "wrong" in context.
Data-Obsessed mindset with the ability to find "signal in the noise" within massive evaluation datasets.
Quality-First mindset with a high bar for technical ship-readiness.
Ability to exercise Strategic Influence across Research, Engineering, and Content teams.

Culture & Benefits

Value diversity of experience, knowledge, backgrounds, and perspectives.
Committed to equal employment opportunity regardless of sex, race, religion, or belief.
Provide accommodation for disabilities or additional needs.