Senior Engineering Manager (AI)

TL;DR

Senior Engineering Manager (AI): Leading the team responsible for the AI Runtime product and its foundational infrastructure with an accent on distributed training orchestration, GPU performance, and scalability. Focus on driving architectural decisions for managed GPU training at scale, mentoring high-performing engineers, and delivering robust infrastructure for frontier model development.

Location: Must be based in Mountain View or San Francisco, California

Salary: $228,600 – $297,120 USD

Company

Databricks is the data and AI company, providing a unified Data Intelligence Platform used by over 50% of the Fortune 500 to democratize data, analytics, and AI.

What you will do

• Lead, mentor, and grow a high-performing engineering team focused on Custom Training products and distributed training orchestration.
• Define and own the technical roadmap for AI Runtime, balancing customer experience with foundational infrastructure investments.
• Drive architectural decisions for managed GPU training at scale, including cluster lifecycle and training efficiency.
• Collaborate across platform, product, and research organizations to ensure end-to-end delivery of training capabilities.
• Build observability and reliability practices for long-running, multi-node training jobs, including failure recovery and checkpointing.
• Partner with recruiting to attract and develop top-tier engineering talent.

Requirements

• 8+ years of software engineering experience, including 3+ years in engineering management.
• Proven track record building and operating managed GPU training infrastructure at scale.
• Deep familiarity with distributed training frameworks like PyTorch, DeepSpeed, or Megatron-LM.
• Strong understanding of GPU performance fundamentals, including NCCL and memory optimization.
• Experience building platform products with clear SLAs and ownership of the customer experience.
• BS/MS in Computer Science, Electrical Engineering, or a related technical field.

Culture & Benefits

• Comprehensive benefits package tailored to regional needs.
• Commitment to a diverse and inclusive culture with equal employment opportunity standards.
• Opportunity to work on state-of-the-art AI infrastructure used by global enterprises.
• Collaborative environment working closely with research and platform teams.