Senior Perception Engineer (AI)

TL;DR

Senior Perception Engineer (AI): Developing next-generation 3D occupancy and segmentation networks for autonomous vehicles with an accent on multi-modal sensor fusion and high-performance deep learning models. Focus on architecting temporally consistent voxel representations to enable safe navigation in complex urban environments.

Location: Must be based in or able to work from Foster City, CA (Hybrid)

Salary: $242,000 - $290,000 per year

Company

Zoox is building a ground-up, fully autonomous vehicle fleet and the supporting ecosystem for next-generation urban mobility-as-a-service.

What you will do

• Design and implement multi-modal sensor fusion architectures (Lidar, Camera, Radar) for 3D occupancy and semantic segmentation.
• Develop vision-first fusion strategies to improve geometric understanding and reduce reliance on sparse sensor data.
• Engineer temporal processing modules to ensure prediction stability and consistency.
• Optimize model architectures for real-time on-vehicle inference while meeting strict latency requirements.
• Collaborate with tracking, prediction, and planning teams to refine geometric outputs for complex maneuvering.

Requirements

• MS or PhD in Computer Science, Robotics, Machine Learning, or a related field.
• 6+ years of industry experience in 3D Computer Vision and Deep Learning.
• Deep expertise in voxel-based or BEV (Bird's Eye View) architectures.
• Strong proficiency in Python and PyTorch, with experience in C++ for model integration.
• Experience with multi-sensor fusion and temporal data sequences.

Nice to have

• Experience optimizing models for TensorRT/CUDA for low-latency inference.
• Familiarity with sparse convolutions or query-based architectures.
• Experience with Vision Language Models, multi-modal 3D foundation models, or World Models.

Culture & Benefits

• Comprehensive health, dental, and vision insurance.
• Long-term and short-term disability and life insurance.
• Competitive compensation package including Amazon RSUs and Zoox Stock Appreciation Rights.
• Flexible paid time off including sick leave and vacation.
• Collaborative environment focused on robotics and autonomous vehicle innovation.