Staff Software Engineer (AI)

TL;DR

Staff Software Engineer (AI): Designing and building systems for hosting and serving AI model inference with an accent on scalability, reliability, and operational excellence. Focus on optimizing performance and collaborating across teams to deliver a world-class foundation model API product.

Company

Databricks is the data and AI company, providing a platform that unifies and democratizes data, analytics, and AI for over 10,000 organizations worldwide.

What you will do

• Design and implement core systems and APIs for Databricks Foundation Model Serving.
• Partner with leadership to define the technical roadmap and architecture.
• Drive architectural decisions to optimize performance and operational efficiency.
• Contribute to key components across the serving infrastructure.
• Collaborate with cross-functional teams to translate customer needs into systems.
• Establish best practices for code quality and mentor other engineers.

Requirements

• 10+ years of experience in large-scale distributed systems.
• Experience with high-scale operationally sensitive backend systems.
• Strong foundation in algorithms, data structures, and system design.
• Proven ability to deliver complex, high-impact initiatives.
• Strong communication skills and ability to collaborate across teams.
• Passion for mentoring and fostering technical excellence.