Staff Software Engineer (AI/ML)

TL;DR

Staff Software Engineer (AI/ML): Designing and building systems for high-throughput, low-latency inference across CPU and GPU workloads with an accent on scalability, reliability, and operational excellence. Focus on driving architectural decisions and optimizing performance for model serving infrastructure.

Location: Remote (US)

Salary: $192,000—$260,000 USD

Company

Databricks is the data and AI company, providing a platform relied upon by over 10,000 organizations worldwide.

What you will do

• Design and implement core systems and APIs for Databricks Model Serving.
• Define the technical roadmap and long-term architecture for serving workloads.
• Drive architectural decisions to optimize performance for CPU and GPU workloads.
• Contribute to key components across the serving infrastructure.
• Collaborate with product, platform, and research teams.
• Establish best practices for code quality and mentor other engineers.

Requirements

• 10+ years of experience in large-scale distributed systems.
• Deep expertise in model serving and inference systems.
• Strong foundation in algorithms and system design.
• Proven ability to deliver high-impact initiatives.
• Experience leading architecture for performance-sensitive systems.
• Strong communication skills and collaborative mindset.