Staff Backend Software Engineer (AI)

TL;DR

Staff Backend Software Engineer (AI): Building LLM infrastructure to power AI applications for customers, focusing on reliability, latency, and efficiency of distributed AI workloads. Focus on collaborating with platform, infrastructure, and ML teams to deliver seamless end-to-end AI experiences and shaping how developers and data scientists build and interact with AI on hirify.global.

Location: New York, United States

Salary: $190,000 — $261,250 USD

Company

hirify.global is the data and AI company that provides a Data Intelligence Platform to unify and democratize data, analytics and AI.

What you will do

• Build LLM infrastructure powering trillions of tokens per week for customers.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infrastructure, and ML teams to deliver seamless end-to-end experiences.
• Shape how developers and data scientists build and interact with AI on hirify.global.

Requirements

• 8+ years of experience in backend or infrastructure engineering.
• Strong programming skills in Scala, Go, or Python.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Familiarity with service-oriented architecture, deployment pipelines, and system observability.
• Strong product and ownership mindset.

Nice to have

• Experience with real-time serving, ML infrastructure, or GPU orchestration.
• Exposure to platforms like SageMaker, Vertex AI, or Azure ML.
• Contributions to OSS projects like MLflow, PyTorch, Ray, vLLM, SGLang.
• Built developer platforms or internal tools supporting AI workflows.

Culture & Benefits

• Comprehensive benefits and perks to meet the needs of all employees.
• Committed to fostering a diverse and inclusive culture where everyone can excel.
• Inclusive hiring practices that meet equal employment opportunity standards.