Machine Learning Engineer - Perception Offline Driving Intelligence (AI)

TL;DR

Machine Learning Engineer - Perception Offline Driving Intelligence (AI): Developing multimodal large language models to enhance environmental understanding for robotaxis with an accent on efficiently identifying hazards and interpreting driving restrictions. Focus on driving end-to-end ML solutions from research to production and optimizing them using real-world scenarios.

Location: Hybrid role based in Boston, MA.

Salary: $179,000–$245,000 a year

Company

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market.

What you will do

• Develop multimodal large language models that enhance robotaxis' understanding of complex urban environments.
• Implement model architectures and sophisticated training techniques.
• Build large high-quality datasets leveraging sensor stack inputs and extensive Zoox data.
• Drive end-to-end ML solutions from research to production, utilizing Zoox's data pipelines and infrastructure.
• Collaborate with perception, planning, safety, and systems teams to integrate models into the vehicle's decision-making pipeline.
• Validate and optimize solutions using real-world driving scenarios to contribute to safety and reliability.

Requirements

• MS or PhD in Computer Science, Machine Learning, or related technical field.
• Demonstrated experience training and deploying large language models (LLMs).
• Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluation.
• Proficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects.
• Experience training models with large-scale data.

Nice to have

• Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA).
• Experience with autonomous robotics systems.

Culture & Benefits

• Comprehensive package including paid time off (sick leave, vacation, bereavement).
• Zoox Stock Appreciation Rights and Amazon RSUs.
• Health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.