Senior AI Product Manager (Copilot)

TL;DR

Senior AI Product Manager (Copilot): Driving Copilot model capabilities like tool-use to ensure high-quality, grounded, reliable, and cost-efficient responses from language models with an accent on LLM platform strategy, model evaluation, and execution in partnership with research and engineering. Focus on prototyping approaches, identifying and prioritizing platform issues, and defining measurable evaluations to demonstrate quality improvements.

Location: Mountain View, United States. Employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) of that location.

Salary: USD $100,600 – $199,000 per year (U.S.), or USD $131,400 – $215,400 per year (San Francisco Bay area and New York City metropolitan area).

Company

hirify.global creates unique, beautiful and powerful products that will change lives, running lean, obsessing about users, and building products that will define the AI era.

What you will do

• Develop and execute LLM platform strategy for Copilot.
• Prototype approaches for steering language models to drive response quality across a wide range of scenarios.
• Identify and prioritize platform, orchestration, and language model issues.
• Define and build measurable evaluations with relevant datasets.
• Define, deploy, and manage experiments in production.
• Partner with product teams to scale tool building and resolve dependencies.

Requirements

• Bachelor’s Degree AND 5+ years experience in product management OR equivalent experience.
• 3+ years of experience leading ambiguous product areas, defining requirements, developing roadmaps, and working with multi-disciplinary teams.
• 2+ years of experience building ML-powered or LLM-powered products.
• Hands-on experience with LLM APIs (e.g., OpenAI, Anthropic, Azure OpenAI), embeddings, vector databases, and tool use.
• Hands-on experience with prompt design, context window management, and model evaluation.

Nice to have

• 2+ years of hands-on experience in building retrieval and/or recommendation systems.
• 1+ years of experience in building LLM applications with familiarity in agent and orchestration frameworks.
• Technical depth in software development, data science, and machine learning.
• Experience using and applying Large Language Models, including prompt engineering and evaluation.

Culture & Benefits

• Work in a small, friendly, fast-moving team pushing the boundaries of technology.
• Opportunity to do the best work, always breaking new ground and shipping regularly.
• Emphasis on positive energy, empathy, kindness, and being highly effective.
• Collaborate with a growth mindset, innovate, and achieve shared goals.
• Values of respect, integrity, and accountability to create an inclusive culture.