Operations Manager (AI Infrastructure)

Location: San Francisco, United States; hybrid

Salary: $225,000–$235,000 per year plus equity

Company

Baseten provides mission-critical AI inference infrastructure, applied AI research, and developer tooling for companies bringing machine learning models into production.

What you will do

• Manage the operational and analytical supply side of the GPU fleet across neocloud and bare metal environments.
• Drive suppliers to keep the maximum amount of GPU capacity online and healthy.
• Reconcile contracted, provisioned, healthy, and utilized capacity by supplier and cluster.
• Own supplier accountability for replacement SLAs, mean time to repair, RMA cycles, and fleet health.
• Monitor SLA performance, pursue credit claims, and enforce remediation plans.
• Coordinate internal communications for supplier maintenance affecting availability.

Requirements

• 5–10+ years of infrastructure experience focused on the compute lifecycle and maximizing functional compute.
• Direct experience managing GPU, server, or data center hardware supplier relationships.
• Understanding of fleet health, RMA processes, and the differences between contracted and delivered capacity.
• Strong analytical skills, including independently extracting data, building reports, and generating insights.
• Ability to operate effectively in ambiguous environments and define needed processes.
• Strong collaboration skills across finance, infrastructure and engineering, legal, and security.

Nice to have

• Experience at a hyperscaler, neocloud provider, or AI infrastructure company.
• Familiarity with NVIDIA H100, H200, or GB200-class systems, power and thermal constraints, and compute supply chains.
• Experience running formal supplier corrective actions.

Culture & Benefits

• Competitive compensation with meaningful equity.
• Medical, dental, and vision insurance fully covered for employees and dependents.
• Flexible PTO and a company-wide winter break.
• Paid parental leave and a fertility and family-building stipend.
• Company-facilitated 401(k).
• Exposure to a variety of machine learning startups and AI infrastructure environments.