Senior Product Manager (AI)

TL;DR

Senior Product Manager (AI): Driving Copilot model capabilities like tool-use to ensure high-quality, grounded, reliable, and cost-efficient responses from language models powering Microsoft Copilot with an accent on developing LLM platform strategy, prototyping approaches to improve response quality, and defining measurable evaluations with relevant datasets. Focus on identifying and prioritizing platform, orchestration, and language model issues, and deploying experiments to impact language model tool use and user engagement.

Location: Hybrid (Mountain View, United States). Employees living within 50 miles of a Microsoft office are expected to work from the office at least four days a week.

Salary: The typical base pay range for this role across the U.S. is USD $119,800 – $274,800 per year. For San Francisco Bay area and New York City metropolitan area, the base pay range is USD $158,400 – $304,200 per year.

Company

hirify.global is a fast-moving team creating unique, beautiful, and powerful products that will define the AI era.

What you will do

• Develop and execute LLM platform strategy for Copilot to extend language model capabilities.
• Prototype approaches to steer language models and drive response quality across a wide range of scenarios.
• Identify and prioritize platform, orchestration, and language model issues that impact quality, factuality, and safety, working with engineers and researchers for resolution.
• Define and build measurable evaluations with relevant datasets to demonstrate quality improvements.
• Define, deploy, and manage experiments in production that impact language model tool use, driving measurable improvements in relevance and engagement with Copilot users.
• Partner with product teams to scale tool building and work with inference, agents, and orchestration teams to resolve dependencies.

Requirements

• Bachelor’s Degree AND 5+ years experience in product management OR equivalent experience.
• 3+ years of experience leading ambiguous product areas, defining requirements, developing roadmaps, and working with multi-disciplinary teams to execute them.
• 2+ years of experience building ML-powered or LLM-powered products.
• Hands-on experience with LLM APIs (e.g., OpenAI, Anthropic, Azure OpenAI), embeddings, vector databases, and tool use.
• Hands-on experience with prompt design, context window management, and model evaluation.

Culture & Benefits

• Work in a small, friendly, fast-moving team that supports each other.
• Focus on breaking new ground and shipping regularly for real and immediate impact.
• Decisions are made based on evidence, with an obsession about users.
• Opportunity to work with a growth mindset, innovate, and collaborate while upholding values of respect, integrity, and accountability.