Product Manager, Inference Experience (AI)

Location: Hybrid in San Francisco or New York, United States

Salary: $200K–$400K, plus equity

Company

Baseten provides inference infrastructure and developer tooling for AI companies, building a cloud platform that combines inference, training, and agent execution.

What you will do

• Own product strategy and roadmap for inference offerings, including Model APIs, Dedicated Inference, Model Evaluations, and the Model Library.
• Improve how developers discover, evaluate, deploy, optimize, and manage AI models through APIs, SDKs, CLI, and console.
• Partner with inference engineers and researchers to turn technical advances into customer-facing capabilities.
• Prioritize models, workloads, and customer needs while working with developers and customers.
• Partner with GTM and leadership on pricing, packaging, launches, and commercialization.
• Drive developer adoption, measurable business impact, successful launches, and sustained production use.

Requirements

• 10+ years of experience building and shipping AI/ML products or platforms.
• Technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
• Direct experience building or deploying models with technologies such as PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo, or similar frameworks.
• Strong understanding of model serving, GPU economics, and trade-offs between quality, latency, throughput, and cost.
• Strong developer product instincts and the ability to make complex technology approachable without sacrificing power.
• Track record of leading cross-functional product initiatives and turning technical capabilities into measurable adoption or revenue growth.

Nice to have

• Experience deploying models, building infrastructure products or ML infrastructure, or designing tools used from both a terminal and a console.
• Previous experience as a software developer.

Culture & Benefits

• Meaningful equity and competitive compensation.
• U.S. employees and dependents receive 100% coverage for medical, dental, and vision insurance.
• Flexible PTO and company-wide Winter Break from Christmas Eve through New Year's Day.
• Paid parental leave and a fertility and family-building stipend through Carrot.
• U.S. employees have access to a company-facilitated 401(k).
• Exposure to ML startups and learning and networking opportunities.