Staff Backend Software Engineer (AI Platform)

TL;DR

Staff Backend Software Engineer (AI Platform): Building the infrastructure that powers data apps, AI agents, model training, model serving, and vector search with an accent on reliability, latency, and efficiency of distributed AI workloads. Focus on shaping how developers and data scientists build and interact with AI on hirify.global.

Location: San Francisco, California

Salary: $166,000 — $225,000 USD

Company

hirify.global is the data and AI company that unifies and democratizes data, analytics and AI for more than 10,000 organizations worldwide.

What you will do

• Build infrastructure that powers flagship offerings like MLflow, AI Gateway, hirify.global Apps, Agent Framework, Agent Bricks, and Foundation Model APIs.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences.
• Shape how developers and data scientists build and interact with AI on hirify.global.

Requirements

• 5+ years of experience in backend or infrastructure engineering.
• Strong programming skills in Scala, Go, or Python.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Familiarity with service-oriented architecture, deployment pipelines, and system observability.
• Strong product and ownership mindset.

Nice to have

• Experience with real-time serving, ML infrastructure, or GPU orchestration.
• Exposure to platforms like SageMaker, Vertex AI, or Azure ML.
• Contributions to OSS projects like MLflow, PyTorch, or Ray.
• Built developer platforms or internal tools supporting AI workflows.

Culture & Benefits

• Committed to fostering a diverse and inclusive culture where everyone can excel.
• Hiring practices are inclusive and meet equal employment opportunity standards.
• Comprehensive benefits and perks that meet the needs of all employees.