Senior Backend Software Engineer (AI Platform)

TL;DR

Senior Backend Software Engineer (AI Platform): Building infrastructure powering AI products like MLflow, AI Gateway, and Foundation Model APIs with an accent on distributed AI workloads, reliability, and efficiency. Focus on designing scalable APIs, collaborating across platform and ML teams, and advancing AI infrastructure at enterprise scale.

Location: Remote (US)

Salary: $166,000–$225,000 USD

Company

hirify.global is a leading data and AI company powering over 10,000 organizations worldwide with its Data Intelligence Platform, founded by creators of Apache Spark and MLflow.

What you will do

• Build infrastructure for flagship AI offerings including MLflow, AI Gateway, and Foundation Model APIs
• Improve reliability, latency, and efficiency of distributed AI workloads
• Collaborate with platform, infrastructure, and ML teams to deliver seamless end-to-end AI experiences
• Shape developer and data scientist interactions with AI on the hirify.global platform

Requirements

• Must have 5+ years experience in backend or infrastructure engineering
• Strong programming skills in Scala, Go, or Python
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure
• Familiarity with service-oriented architecture, deployment pipelines, and system observability
• Strong product and ownership mindset

Nice to have

• Experience with real-time serving, ML infrastructure, or GPU orchestration
• Exposure to SageMaker, Vertex AI, or Azure ML platforms
• Contributions to OSS projects like MLflow, PyTorch, or Ray
• Built developer platforms or internal tools supporting AI workflows

Culture & Benefits

• Comprehensive benefits tailored to employee needs
• Commitment to diversity and inclusion in hiring and culture
• Global presence with headquarters in San Francisco