Software Engineer, Machine Learning Infrastructure (Generative AI)

Location: San Francisco, CA; Sunnyvale, CA; or Seattle, WA, United States

Salary: $137,100–$201,600, $167,800–$246,800, or $203,500–$299,300 USD annually, depending on level and market. Additional equity grants may be available.

Company

hirify.global operates a technology platform for delivery and builds shared machine learning and Generative AI infrastructure for hirify.global, Wolt, and Deliveroo.

What you will do

• Build production infrastructure that helps teams move Generative AI products, agents, automation, and personalization from prototypes to production.
• Develop evaluation SDKs, OpenTelemetry-based trace and score ingestion, LLM-as-judge workflows, offline and online evaluation pipelines, and agent simulations.
• Design scalable backend services, data pipelines, observability systems, and platform components for high-volume LLM and agent workloads.
• Provide reliable ways to measure model and agent quality, detect regressions, compare models, and manage observability and costs.
• Operate production systems with appropriate latency, scale, monitoring, SLOs, incident response, and performance and cost optimization.
• Collaborate with ML engineers, product engineers, data scientists, and platform teams across hirify.global, Wolt, and Deliveroo.

Requirements

• Bachelor’s, master’s, or PhD in Computer Science or an equivalent field.
• 3+ years of industry experience in software engineering.
• Strong backend engineering fundamentals, especially Python and distributed systems.
• Experience building production services, APIs, data pipelines, or ML infrastructure at scale.
• Experience operating production systems, including observability, debugging, reliability, incident response, and performance or cost optimization.
• Hands-on experience with evaluation, LLM observability, or measurement systems for ML or LLM products in production, plus proficiency with AI coding tools throughout the software development lifecycle.

Nice to have

• Experience with LLM-as-judge methodology, evaluation drift detection, human-in-the-loop labeling, or agent evaluation harnesses.
• Experience with OpenTelemetry, trace and score ingestion, instrumentation SDKs, AI agents, or MCP servers.
• Experience with streaming data pipelines, SQL, columnar or OLAP stores, LLM gateways, model routing, vendor abstraction, or cost attribution.
• Experience building developer or internal platforms, Kubernetes, AWS or GCP, and high-throughput batch systems.
• Experience with RAG, search, vector databases, or open-weights LLM inference and fine-tuning.

Culture & Benefits

• Work with a small, high-leverage team focused on production Generative AI infrastructure.
• Comprehensive benefits for regular employees, including medical, dental, and vision coverage.
• 401(k) plan with employer matching, paid parental leave, wellness benefits, commuter benefits matching, and family-forming assistance.
• Flexible paid time off for salaried roles, 80 hours of paid sick time annually, and 11 paid holidays.
• Disability and basic life insurance and access to a mental health program.