Senior Software Engineer (AI Engineering)

TL;DR

Senior Software Engineer (AI Engineering): Developing Waymo's inference platform to ensure scalability, high throughput, and low latency with an accent on hosting large ML models and LLMs. Focus on improving inference efficiency, deploying model solutions for auto-labeling and active learning, and building highly scalable distributed systems.

Location: Hybrid, Mountain View, California

Salary: $213,000—$263,000 USD

Company

Waymo is an autonomous driving technology company building the world's most experienced autonomous driver to improve mobility and safety.

What you will do

• Develop Waymo's inference platform to ensure it is scalable, high throughput, and low latency.
• Host and integrate internal and external ML models, including LLMs, across various teams.
• Optimize the efficiency of large model inference to increase throughput and reduce costs.
• Deploy and integrate inference solutions for distillation, evaluation, dataset generation, active learning, and auto-labeling.

Requirements

• 5+ years of professional experience in software engineering.
• Proficiency in C++ programming.
• Experience building highly scalable distributed systems.
• Must be based in or authorized to work in the US.

Nice to have

• Experience building model hosting and inference solutions.
• Experience handling exabyte-scale datasets.
• Passion for developing internal infrastructure and tools.

Culture & Benefits

• Discretionary annual bonus program.
• Equity incentive plan.
• Generous company benefits package.
• Opportunity to work on cutting-edge autonomous driving technology.