Software Engineer, ML Serving Platform

Location: San Francisco, CA; Sunnyvale, CA; or Seattle, WA, United States

Salary: $130,600–$192,000 USD annual base salary, plus potential equity grants

Company

hirify.global operates a large-scale technology platform serving search, recommendations, advertising, delivery estimates, and logistics across hirify.global, Wolt, and Deliveroo.

What you will do

• Build self-serve tools, APIs, and workflows for deploying, configuring, validating, and operating machine learning models.
• Connect request routing and online feature retrieval with model inference on CPU and GPU infrastructure.
• Integrate open-source inference frameworks and models into reliable production services.
• Develop modular components for disaggregated serving architectures that can scale independently.
• Improve Kubernetes deployment, resource management, and autoscaling for changing traffic and latency requirements.
• Benchmark, profile, and monitor production systems while improving reliability, automation, runbooks, and on-call operations.

Requirements

• 2+ years of software engineering experience building and maintaining production services or infrastructure.
• Proficiency in a backend or systems programming language such as Java, Kotlin, Go, C++, or Python.
• Understanding of distributed systems, concurrency, networking, timeouts, failure handling, and performance trade-offs.
• Experience debugging production systems and using operational data to improve reliability, performance, or cost.
• Ability to independently create technical designs, tested implementations, and safe production rollouts.
• Degree in Computer Science or a related field, or equivalent practical experience.

Nice to have

• Experience with ML inference infrastructure, online feature retrieval, or latency-sensitive distributed services.
• Experience operating containerized workloads on Kubernetes, including deployment, resource management, or autoscaling.
• Experience building self-serve developer platforms, APIs, or automation.
• Experience integrating open-source infrastructure or models and validating them under production workloads.
• Familiarity with CPU/GPU profiling, inference runtimes, or model deployment workflows.

Culture & Benefits

• Work with internal modelers and engineering teams across multiple business verticals.
• Comprehensive benefits for regular employees, including medical, dental, vision, disability, and basic life insurance.
• 401(k) plan with employer matching and commuter benefits matching.
• Paid parental leave, paid time off, paid sick leave, 11 paid holidays, wellness benefits, family-forming assistance, and mental health support.
• Flexible paid time off for salaried roles.