Senior AI Product Manager (AI Engineering)

TL;DR

Senior AI Product Manager (AI Engineering): Driving Copilot model capabilities to ensure high-quality, grounded, reliable, and cost-efficient language model responses. Focus on prompt design, context window management, and model evaluation.

Location: Must work from a designated Microsoft office at least four days a week if living within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location.

Salary: USD $139,900 – $274,800 per year (USD $188,000 – $304,200 per year within the San Francisco Bay area and New York City metropolitan area).

Company

hirify.global is pushing the boundaries of technology to create unique and powerful AI products.

What you will do

• Develop and execute LLM platform strategy for Copilot to extend language model capabilities.
• Prototype approaches by steering language models to drive response quality across a wide range of scenarios.
• Identify and prioritize platform, orchestration, and language model issues impacting quality, factuality, and safety.
• Define and build measurable evaluations with relevant datasets to demonstrate quality improvements.
• Define, deploy, and manage experiments in production that impact language model’s tool use.
• Partner with product teams to scale tool building and resolve dependencies.

Requirements

• Bachelor’s Degree AND 5+ years experience in product management OR equivalent experience.
• 3+ years of experience leading ambiguous product areas, defining requirements, developing roadmaps, and working with multi-disciplinary teams.
• 2+ years of experience building ML-powered or LLM-powered products.
• Hands-on experience with LLM APIs (e.g. OpenAI, Anthropic, Azure OpenAI), embeddings, vector databases, and tool use.
• Hands-on experience with prompt design, context window management, and model evaluation.

Nice to have

• 2+ years of hands-on experience in building retrieval and/or recommendation systems.
• 1+ years of experience in building LLM applications with familiarity in agent and orchestration frameworks, tool use, LLM evaluations.
• Technical depth in software development, data science and machine learning.
• Experience using and applying Large Language Models.

Culture & Benefits

• Growth mindset, innovate to empower others, and collaborate to realize shared goals.
• Values of respect, integrity, and accountability to create a culture of inclusion.