Technical Program Manager (AI/ML Infrastructure)

Location: Hybrid in San Francisco, Montreal, New York, Seattle, or Toronto.

Salary: $165K–$330K annually, plus equity.

Company

Baseten provides inference infrastructure, applied AI research, and developer tooling that help AI companies deploy cutting-edge models in production.

What you will do

• Run the priority-account operating cadence, including hot-account check-ins, leadership reviews, and account planning with Sales leadership.
• Define ownership, cadences, SLAs, transition criteria, and runbooks across FDE, solution architecture, Sales, Product, infrastructure, capacity, and on-call teams.
• Coordinate dedicated-capacity rollouts, cluster migrations, capacity reservations, and large customer launches.
• Reduce engineering toil by identifying incidents, manual routing, configuration work, and after-hours pages that can be eliminated or reassigned.
• Build and report metrics covering account health, response times, toil, engineer load, and team health.
• Drive team-scaling programs including onboarding, certification, account balancing, runbook coverage, and hiring operations.

Requirements

• 5+ years of experience as a TPM or engineer turned TPM working on infrastructure, cloud, or customer-facing technical programs.
• Technical depth in ML infrastructure systems, Kubernetes, GPUs, and distributed systems, with the ability to follow incident channels and design documents.
• Experience running programs across multiple teams without formal authority.
• Ability to structure escalations, close loops, and manage cross-team risks and dependencies.
• Clear and concise written communication for engineers and executives.
• High ownership and a preference for fixing processes rather than working around them.

Nice to have

• Experience working with an AI or ML infrastructure stack.
• Background in solutions engineering, SRE, or forward-deployed teams.
• Experience with LLM inference.

Culture & Benefits

• Meaningful equity and competitive compensation.
• U.S. employees and dependents receive full medical, dental, and vision insurance coverage.
• Flexible PTO and a company-wide winter break from Christmas Eve through New Year's Day.
• Paid parental leave and a fertility and family-building stipend through Carrot.
• U.S. company-facilitated 401(k) and exposure to a variety of ML startups.