2 months ago
Senior ML Engineer (VLM)
177 300 - 212 800$
Match & Cover letter
Plus required for matching with this vacancy
Job description
Text:
TL;DR
Senior ML Engineer (VLM): Designing and deploying cloud-based pipelines to convert multi-sensor data into VLM/VLA training datasets with an accent on multimodal model integration and auto-labeling. Focus on building reasoning-grounded labels, mining long-tail scenarios, and closing the data flywheel for end-to-end autonomous driving.
Salary: $177,300 - $212,800 USD
Company
is a leader in autonomous driving focused on developing software for automated trucks as part of the Daimler family.
What you will do
- Own the offline dataset pipeline, converting logged multi-sensor data into VLM/VLA training sets.
- Build VLM-assisted auto-labeling using foundation models for dense captioning and semantic enrichment.
- Generate reasoning-grounded labels and chain-of-causation annotations to support VLA training.
- Mine and curate long-tail, high-uncertainty scenarios to measurably improve model metrics.
- Close the data flywheel by defining schemas, quality metrics, and routing failures back to retraining loops.
- Scale distributed, reproducible pipelines using cloud infrastructure and disciplined software practices.
Requirements
- Must be based in the United States.
- 6+ years of experience with a Bachelor's or 3+ years with a Master's in CS, Robotics, or related field.
- Proficiency in Computer Vision and Deep Learning (Object Detection, Tracking, Segmentation, BEV).
- Hands-on experience with Multimodal/VLM, open-vocabulary recognition, or semantic embeddings.
- Experience with distributed ML frameworks (PyTorch, Ray, Spark) and large-scale data processing (Parquet).
- Strong Python software development skills and experience with MLOps tools (MLflow, Weights & Biases).
Nice to have
- Familiarity with VLA driving models, trajectory grounding, or reasoning-trace datasets.
- Experience with high-throughput model serving tools like vLLM or SGLang.
- Knowledge of vector databases (e.g., LanceDB) and AV data standards (ROS bags, MCAP).
- Cloud orchestration skills using Terraform and AWS managed services.
- Publications in top-tier AI/Robotics venues such as CVPR, NeurIPS, or ICCV.
Culture & Benefits
- Competitive compensation package including bonuses and stock options.
- 100% paid medical, dental, and vision premiums for full-time employees.
- 401K plan with a 6% employer match.
- Flexible scheduling and generous paid vacation available immediately.
- Company-wide holiday office closures.
Be careful: if the employer asks you to log into their system using iCloud/Google, send codes/passwords, or run code/software, don't do it - these are scammers. Always click "Report" or contact support. More in guide →
Similar vacancies
11 days ago
Senior Applied Research Scientist (Computer Vision)
180 000 - 230 000$
11 days ago
Senior Staff AI Software Engineer, Perception (Robotics)
238 000 - 372 000$
12 days ago
AI/ML Engineer II (Aerospace)
108 497 - 149 183$
Waymo
11 days ago
Staff Technical Lead Manager, ML Sensor Validation
251 000 - 310 000$
9 days ago
Staff Computer Vision Engineer (AI)
120 800 - 151 000$
Waymo
11 days ago
Sr Staff Tech Lead, Machine Learning Engineer, Perception (Autonomous Driving)
298 000 - 368 000$