Senior Software Engineer, Ml Evaluation Infra And Efficiency (Ai)

Location: Onsite in Mountain View, California

Salary: $238,000—$302,000 USD

Company

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.

What you will do

• Design and build distributed evaluation platforms for large-scale ML evaluation workloads.
• Profile evaluation platforms, identify performance bottlenecks (CPU, memory, I/O, network), and implement optimizations to improve inference speed and resource utilization.
• Collaborate with ML engineers to understand evaluation requirements and scenarios, and improve DevX of the evaluation infrastructure.
• Improve runtime goodput of ML inference workload and efficiency of metrics computations, ensuring scalability and reliability across distributed environments.
• Implement and maintain advanced ML infrastructure tools, including ML Pathways, JAX, Flume and TensorFlow.

Requirements

• B.S. in Computer Science, Math, or 3+ years equivalent real-world experience.
• Proficient in distributed systems design with an understanding of ML efficiency.
• Experience with ML frameworks, including TensorFlow, JAX, XLA.
• Solid programming skills in Python and C++.
• Practical familiarity with profiling tools to uncover performance bottlenecks.

Nice to have

• MS in Computer Science, Math
• Familiarity with large-scale evaluation platforms for LLMs.

Culture & Benefits

• Eligible to participate in Waymo’s discretionary annual bonus program.
• Eligible to participate in Waymo’s equity incentive plan.
• Eligible to participate in Waymo’s generous Company benefits program, subject to eligibility requirements.