Software Engineer (Machine Learning Infrastructure - Generative AI)

Location: San Francisco, CA; Sunnyvale, CA; or Seattle, WA, United States

Salary: $137,100–$201,600 USD; $167,800–$246,800 USD; or $203,500–$299,300 USD annually, depending on level and work location, plus equity opportunities.

Company

hirify.global operates a technology platform supporting delivery and commerce products, including GenAI-powered products, agents, automation, and personalization across hirify.global, Wolt, and Deliveroo.

What you will do

• Build production infrastructure that helps teams move Generative AI products from prototype to production.
• Develop the unified evaluation platform, including evaluation SDKs, OpenTelemetry trace and score ingestion, LLM-as-judge workflows, offline and online evaluation pipelines, and agent simulations.
• Design scalable systems for evaluation workflows, LLM observability, agent simulation, data pipelines, and backend services.
• Enable product teams to measure model and agent quality, detect regressions, compare open-weight and closed-source models, and manage observability and costs.
• Build platforms that support experimentation while meeting production requirements for latency, scale, monitoring, SLOs, playbooks, and operational excellence.
• Partner with ML engineers, product engineers, data scientists, and platform teams to develop GenAI platform primitives and connect evaluation signals to agent optimization and post-training.

Requirements

• Bachelor’s, master’s, or PhD in Computer Science or an equivalent field.
• 3+ years of industry experience in software engineering.
• Strong backend engineering fundamentals, especially Python and distributed systems.
• Experience building production services, APIs, data pipelines, or ML infrastructure at scale.
• Experience operating production systems, including observability, debugging, reliability, incident response, and performance or cost optimization.
• Hands-on experience with evaluation, LLM observability, or measurement systems for ML/LLM products in production, plus proficiency with AI coding tools throughout the software development lifecycle.

Nice to have

• Experience with LLM-as-judge methodology, evaluation drift detection, human-in-the-loop labeling, or agent evaluation harnesses.
• Experience with OpenTelemetry, tracing, instrumentation SDKs, AI agents, or MCP servers.
• Experience with streaming data pipelines, SQL, columnar or OLAP stores, LLM gateways, model routing, vendor abstraction, or cost attribution.
• Experience with developer platforms, Kubernetes, AWS or GCP, high-throughput batch systems, RAG, search, vector databases, or open-weight LLM inference and fine-tuning.

Culture & Benefits

• Work on a small, high-leverage team building centralized Generative AI infrastructure.
• Benefits for regular employees include a 401(k) plan with employer matching, medical, dental, vision, disability, and life insurance.
• Benefits include 16 weeks of paid parental leave, paid time off, paid sick leave, 11 paid holidays, wellness benefits, commuter benefits matching, family-forming assistance, and mental health support.
• Salaried roles provide flexible paid time off and 80 hours of paid sick time per year.