Sr. Manager, Engineering - Model Serving (AI)

TL;DR

Sr. Manager, Engineering - Model Serving (AI): Leading and growing a high-performing engineering team responsible for the customer-facing Model Serving product and its foundational infrastructure with an accent on runtime, APIs, scaling, reliability, and integrations. Focus on driving architectural decisions and product design around latency, throughput, autoscaling, GPU/CPU placement, and cost optimization.

Location: No location is specified.

Salary: $217,000—$312,200 USD

Company

Databricks is the data and AI company that unifies and democratizes data, analytics and AI.

What you will do

• Lead, mentor, and grow a high-performing engineering team responsible for the Model Serving product and its infrastructure.
• Define and own the product and technical roadmap, balancing customer experience, functionality, and foundational investments.
• Collaborate with product, research, platform, and infrastructure teams to drive end-to-end delivery.
• Ensure Model Serving meets stringent SLAs, SLOs, and performance/reliability goals.
• Drive architectural decisions and product design around latency, throughput, autoscaling, GPU/CPU placement, and cost optimization.
• Advocate for customer needs, ensuring engineering decisions translate to product impact.

Requirements

• 5+ years of experience in technical leadership or management.
• Proven track record building and operating large-scale distributed systems, preferably real-time or low-latency APIs.
• Deep understanding of real-time serving systems.
• Experience driving architectural design and operational excellence for production systems with measurable SLAs and SLOs.
• Familiarity with CPU/GPU performance optimization, concurrency, caching, and scalability concepts.
• Excellent collaboration and communication skills across engineering, product, and research organizations.

Culture & Benefits

• Comprehensive benefits and perks to meet the needs of all employees.
• Fostering a diverse and inclusive culture where everyone can excel.
• Hiring practices are inclusive and meet equal employment opportunity standards.