Senior AI Infrastructure Engineer - Model Training (AI)

TL;DR

Senior AI Infrastructure Engineer (Model Training): Designing high-throughput data loading and distributed training systems for multimodal sensor data with an accent on GPU utilization and scaling large-scale world models. Focus on optimizing distributed training frameworks (FSDP/ZeRO), eliminating bottlenecks in petabyte-scale pipelines, and maximizing hardware efficiency of NVIDIA B200s.

Location: Onsite in Mountain View, CA

Salary: $190,000 - $260,000 USD

Company

A leader in autonomous ground transportation developing AI-powered technology stacks for commercial trucking and the public sector.

What you will do

• Design high-throughput data loading and streaming systems for multimodal sensor data (camera, LiDAR, radar), including dataset formats and sharding strategies.
• Build and optimize distributed training infrastructure across multi-node GPU clusters using data, tensor, pipeline, and fully sharded (FSDP/ZeRO) parallelism.
• Maximize utilization of NVIDIA B200 accelerators through mixed-precision training (BF16/FP8), fused kernels, and memory optimization.
• Profile end-to-end training pipelines to identify and eliminate bottlenecks across storage, network, CPU preprocessing, and GPU compute.
• Develop scalable dataset construction pipelines to convert petabytes of raw driving logs into streamable formats.
• Collaborate with ML teams to scale new architectures from prototype to full-cluster training runs.

Requirements

• BS, MS, or PhD in Computer Science or a related field.
• 2-3+ years of industry experience in ML systems or infrastructure.
• Hands-on experience with distributed training frameworks (PyTorch DDP/FSDP, DeepSpeed, Megatron, NCCL).
• Experience building high-performance data pipelines for large-scale training (WebDataset, MosaicML Streaming/MDS).
• Deep understanding of GPU performance, mixed precision, and profiling tools (Nsight, PyTorch Profiler).
• Strong Python skills and proficiency in PyTorch internals.

Nice to have

• Systems-level experience with C++, CUDA, or Triton.

Culture & Benefits

• Competitive compensation package including equity and annual bonuses.
• Comprehensive Medical, Dental, and Vision plans including infertility benefits.
• Flexible PTO, 10 paid holidays, and generous parental leave policies.
• Onsite perks: dog-friendly office, free catered lunch, fully stocked kitchen, and free EV charging.
• Fidelity 401(k), HSA, and Dependent Care FSA.
• Wellbeing benefits including Headspace, Calm, One Medical, and Gympass.