Senior Backend Engineer (AI)

Location: Onsite in New York City, New York, USA

Salary: $165,300–$219,675 USD

Company

Databricks is the data and AI company, providing a data intelligence platform to unify and democratize data, analytics and AI for over 10,000 organizations worldwide.

What you will do

• Build infrastructure that powers flagship offerings like MLflow, AI Gateway, Databricks Apps, Agent Framework, Agent Bricks, and Foundation Model APIs.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences.
• Shape how developers and data scientists build and interact with AI on Databricks.

Requirements

• 5+ years of experience in backend or infrastructure engineering.
• Strong programming skills in Scala, Go, or Python.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Familiarity with service-oriented architecture, deployment pipelines, and system observability.
• Strong product and ownership mindset.

Nice to have

• Experience with real-time serving, ML infrastructure, or GPU orchestration.
• Exposure to platforms like SageMaker, Vertex AI, or Azure ML.
• Contributions to OSS projects like MLflow, PyTorch, or Ray.
• Built developer platforms or internal tools supporting AI workflows.

Culture & Benefits

• Comprehensive benefits and perks are provided.
• Commitment to fostering a diverse and inclusive culture.
• Equal employment opportunity standards are met in hiring practices.
• Consideration for employment is without regard to protected characteristics.