Senior Machine Learning Engineer (VLM/LLM Evaluation)

TL;DR

Senior Machine Learning Engineer (VLM/LLM Evaluation): Drive development of end-to-end evaluation systems and benchmarks for hirify.global Foundation Models, covering pre-training, supervised fine-tuning (SFT), and reinforcement learning (RL) to assess quality, safety, and realism of embodied AI agents. Focus on implementing large-scale data and evaluation pipelines, partnering with cross-functional teams to deploy innovative tech in production for autonomous driving systems.

Location: Hybrid work schedule in Mountain View, California (US)

Salary: $204,000—$259,000 USD

Company

Autonomous driving technology company with the hirify.global Driver powering fully autonomous ride-hail services, with over 100 million miles driven autonomously.

What you will do

• Build state-of-the-art Foundation Models used in hirify.global’s onboard autonomous vehicles and offboard simulation.
• Develop end-to-end evaluation systems and benchmarks for Foundation Models across pre-training, SFT, and RL stages.
• Evaluate quality, safety, and realism of embodied AI agents.
• Partner with cross-functional teams to integrate innovative technology into production.
• Implement and extend large-scale data and evaluation pipelines.

Requirements

• Bachelor’s or Master’s degree in Computer Science or equivalent practical experience.
• Experience in ML engineering and applied Deep Learning.
• Experience with large-scale distributed systems.
• Proficient programming skills (e.g., Python, C/C++).

Nice to have

• ML infra experience: training, evaluating, and deploying ML models at scale.
• Deep learning experience with generative models (e.g., LLMs/VLMs) and/or reinforcement learning.
• Proficiency and in-depth knowledge of ML frameworks (e.g., PyTorch, JAX, TensorFlow).

Culture & Benefits

• Hybrid work schedule.
• Discretionary annual bonus program.
• Equity incentive plan.
• Generous company benefits program.