Senior Software Engineer, Ml Evaluation Infra And Efficiency (Ai)

TL;DR

Senior Software Engineer, ML Evaluation Infra and Efficiency (AI): Designing and building distributed evaluation platforms for large-scale ML evaluation workloads with an accent on improving inference speed and resource utilization. Focus on improving runtime goodput of ML inference workload and efficiency of metrics computations, ensuring scalability and reliability across distributed environments.

Location: Onsite in Mountain View, California

Salary: $238,000—$302,000 USD

Company

hirify.global is an autonomous driving technology company with the mission to be the world's most trusted driver.

What you will do

• Design and build distributed evaluation platforms for large-scale ML evaluation workloads.
• Profile evaluation platforms, identify performance bottlenecks (CPU, memory, I/O, network), and implement optimizations to improve inference speed and resource utilization.
• Collaborate with ML engineers to understand evaluation requirements and scenarios, and improve DevX of the evaluation infrastructure.
• Improve runtime goodput of ML inference workload and efficiency of metrics computations, ensuring scalability and reliability across distributed environments.
• Implement and maintain advanced ML infrastructure tools, including ML Pathways, JAX, Flume and TensorFlow.

Requirements

• B.S. in Computer Science, Math, or 3+ years equivalent real-world experience.
• Proficient in distributed systems design with an understanding of ML efficiency.
• Experience with ML frameworks, including TensorFlow, JAX, XLA.
• Solid programming skills in Python and C++.
• Practical familiarity with profiling tools to uncover performance bottlenecks.

Nice to have

• MS in Computer Science, Math
• Familiarity with large-scale evaluation platforms for LLMs.

Culture & Benefits

• Eligible to participate in hirify.global’s discretionary annual bonus program.
• Eligible to participate in hirify.global’s equity incentive plan.
• Eligible to participate in hirify.global’s generous Company benefits program, subject to eligibility requirements.