Senior Software Engineer (AI/ML)

Location: San Francisco, California, United States

Salary: $166,000–$225,000 USD per year

Company

Databricks builds a unified Data + AI Platform used by organizations worldwide to develop and scale data, AI, analytics, and agent applications.

What you will do

• Design and implement core systems and APIs for Databricks Model Serving.
• Build high-throughput, low-latency inference infrastructure for CPU and GPU workloads.
• Make architectural decisions covering performance, throughput, autoscaling, reliability, and operational efficiency.
• Develop serving components including model container builds, deployment workflows, routing, caching, observability, and intelligent autoscaling.
• Collaborate with product, platform, infrastructure, and research teams to deliver reliable systems aligned with customer needs.
• Lead technical initiatives, establish engineering best practices, and mentor other engineers.

Requirements

• 5+ years of experience building and operating large-scale distributed systems.
• Experience with model serving, inference systems, or related infrastructure such as routing, scheduling, autoscaling, and observability.
• Strong knowledge of algorithms, data structures, and system design for large-scale, low-latency systems.
• Experience designing performance-sensitive CPU/GPU inference architecture.
• Ability to deliver technically complex initiatives with measurable customer or business impact.
• Strong communication, cross-functional collaboration, customer focus, and mentoring skills.

Culture & Benefits

• Comprehensive benefits and perks tailored to employees in each region.
• Inclusive culture focused on equal employment opportunity and enabling employees to excel.
• Opportunities to contribute to foundational data and AI infrastructure used by thousands of organizations.