Lead Software Engineer (AI)

TL;DR

Lead Software Engineer (AI): Building a first-class observability and root-cause analysis system for GPU fabrics with an accent on high-volume telemetry ingestion, topology modeling, and real-time failure diagnosis. Focus on solving complex distributed systems challenges at the boundary of networking and inference software to ensure reliability for large-scale AI model deployment.

Location: Must be based in or able to work from San Francisco (Hybrid)

Salary: $200,000 – $380,000

Company

Baseten powers mission-critical inference for the world's most dynamic AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling.

What you will do

• Own the architecture for GPU fabric observability and root-cause analysis.
• Build telemetry pipelines across switches, NICs, hosts, GPUs, Kubernetes, and inference services.
• Model topology, flow paths, and failure domains to isolate system faults.
• Differentiate between fabric, host, NIC, GPU, kernel, driver, and workload failures.
• Create actionable operator workflows for triage, remediation, and post-incident learning.

Requirements

• Staff-level or senior staff-level experience building production infrastructure software.
• Strong background in distributed systems, specifically streaming, telemetry, or control-plane software.
• Experience processing high-volume, high-cardinality, noisy operational data.
• Deep understanding of networking fundamentals and high-performance networks.
• Ability to work with low-level infrastructure signals to build anomaly detection systems.

Culture & Benefits

• Competitive compensation with meaningful equity grants.
• 100% coverage of medical, dental, and vision insurance for employees and dependents.
• Flexible PTO policy including a company-wide Winter Break.
• Paid parental leave and fertility/family-building stipends.
• Company-facilitated 401(k) plan.
• Exposure to a variety of ML startups and networking opportunities.