Technical Program Manager (AI)

Location: Hybrid in San Francisco, Montreal, New York, or Toronto

Salary: $165,000–$330,000 USD annually, plus equity

Company

Baseten provides applied AI research, inference infrastructure, and developer tooling for bringing machine learning models into production.

What you will do

• Own execution across the Model Performance team's active project portfolio.
• Build planning structures, operating cadences, and status-reporting mechanisms from the ground up.
• Coordinate model release and optimization programs end to end, including day-zero launches.
• Sequence work across performance engineering, infrastructure, and release stakeholders.
• Drive alignment as initiatives expand into Model APIs and the production inference stack.
• Surface risks and dependencies, provide clear status updates, and help define team structures and ownership boundaries.

Requirements

• Deep technical program management experience in an organization of similar or greater complexity.
• Experience program-managing model performance or inference optimization work.
• Understanding of how vLLM, TensorRT-LLM, SGLang, or NVIDIA Dynamo fit into production serving stacks.
• Experience building programs from zero to one and operating effectively in ambiguity.
• Ability to influence engineers, managers, and leadership without direct authority.
• Excellent written and verbal communication, strong ownership, and high-agency decision making.

Nice to have

• Experience coordinating model release programs and day-zero launches for large-scale models.
• Prior hands-on software engineering experience.
• Deep learning performance optimization experience, particularly in inference.

Culture & Benefits

• Competitive compensation with meaningful equity.
• Medical, dental, and vision insurance fully covered for employees and dependents.
• Flexible PTO and a company-wide Winter Break.
• Paid parental leave and a fertility and family-building stipend.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups and related learning and networking opportunities.