Senior Backend Engineer (AI)

TL;DR

Senior Backend Engineer (AI): Building infrastructure that powers AI platform products with an accent on improving reliability, latency, and efficiency of distributed AI workloads. Focus on shaping how developers and data scientists build and interact with AI on hirify.global.

Location: Onsite in New York City, New York, USA

Salary: $165,300–$219,675 USD

Company

hirify.global is the data and AI company, providing a data intelligence platform to unify and democratize data, analytics and AI for over 10,000 organizations worldwide.

What you will do

• Build infrastructure that powers flagship offerings like MLflow, AI Gateway, hirify.global Apps, Agent Framework, Agent Bricks, and Foundation Model APIs.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences.
• Shape how developers and data scientists build and interact with AI on hirify.global.

Requirements

• 5+ years of experience in backend or infrastructure engineering.
• Strong programming skills in Scala, Go, or Python.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Familiarity with service-oriented architecture, deployment pipelines, and system observability.
• Strong product and ownership mindset.

Nice to have

• Experience with real-time serving, ML infrastructure, or GPU orchestration.
• Exposure to platforms like SageMaker, Vertex AI, or Azure ML.
• Contributions to OSS projects like MLflow, PyTorch, or Ray.
• Built developer platforms or internal tools supporting AI workflows.

Culture & Benefits

• Comprehensive benefits and perks are provided.
• Commitment to fostering a diverse and inclusive culture.
• Equal employment opportunity standards are met in hiring practices.
• Consideration for employment is without regard to protected characteristics.