Senior/Staff Software Engineer (Machine Learning Platform)

TL;DR

Senior/Staff Software Engineer (Machine Learning Platform): Building and optimizing a scalable machine learning and deep learning platform within hirify.global with an accent on ML/LLM inference engines, orchestration, and performance. Focus on defining technical strategies, evolving core platform architecture for state-of-the-art ML workloads, and ensuring operational excellence of services.

Location: This position is based in Menlo Park, CA, and Bellevue, WA. For jobs located in the United States.

Compensation: $236,000 - $339,250

Company

hirify.global is a fast-growing product company empowering enterprises with a scalable machine learning and data platform.

What you will do

• Define and own the roadmap for native state-of-the-art machine learning on hirify.global.
• Build and execute a vision for incorporating new advances in machine learning.
• Ensure operational excellence, reliability, availability, and performance of services.
• Collaborate with ML partner teams to improve ML development velocity and capabilities.
• Support team members in delivering high technical quality.

Requirements

• 7+ years of industry experience designing, building, and supporting Internet serving infrastructure, machine learning platforms, services, and frameworks.
• Strong track record with machine learning systems and/or platforms.
• Experience serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang.
• Experience serving fine-tuned LLMs (PEFT, DPO, RL).
• Previous experience in building batch and real-time ML serving systems preferred.
• BS/MS/PhD in Computer Science or related majors, or equivalent experience.

Culture & Benefits

• Culture focused on impact, innovation, and collaboration.
• Opportunity to build big, move fast, and advance technology and careers.
• Employees are expected to follow company’s confidentiality and security standards.
• Team-oriented environment valuing growth, challenging ordinary thinking, and pushing innovation.