Head Of Data Center Infrastructure (AI)

TL;DR

Head of Data Center Infrastructure (AI): Leading the strategy, design, and execution of high-density GPU data centers with an accent on power distribution, cooling architecture, and physical network infrastructure. Focus on scaling infrastructure to hundreds of megawatts, managing external contractors, and establishing operational standards for mission-critical AI inference.

Location: Must be based in or able to work from San Francisco or New York (Hybrid)

Salary: $165,000 – $380,000

Company

Baseten provides mission-critical inference infrastructure for AI companies, enabling the deployment of cutting-edge models into production.

What you will do

• Own the end-to-end strategy, design, and execution of first-generation GPU data centers.
• Define architecture for electrical, mechanical, and physical network systems.
• Lead rack design, power distribution, and cooling systems supporting 150kW+ densities.
• Manage A/E firms, general contractors, and low-voltage vendors.
• Establish maintenance programs, runbooks, and deployment standards.
• Build and lead the internal data center engineering and operations team.

Requirements

• Proven experience designing and delivering large-scale data center infrastructure.
• Deep technical knowledge of electrical distribution and cooling systems.
• Experience with high-density racks and GPU-specific infrastructure.
• Familiarity with structured cabling, LVC, and fiber documentation.
• Strong track record of managing contractors, vendors, and engineering firms.
• Ability to operate effectively at both strategic and hands-on levels.

Culture & Benefits

• Competitive compensation with meaningful equity grants.
• 100% coverage of medical, dental, and vision insurance for employees and dependents.
• Flexible PTO policy including a company-wide Winter Break.
• Paid parental leave and fertility/family-building stipends.
• Company-facilitated 401(k) plan.
• Exposure to top-tier ML startups and networking opportunities.