Senior Engineering Manager (Pipelines Engine)

TL;DR

Senior Engineering Manager (Pipelines Engine): Leading the team responsible for next-generation Runtime ETL features and Agentic Data Engineering infrastructure with an accent on high-performance ETL workloads and engine scalability. Focus on building reliable infrastructure services, managing technical debt, and scaling top-tier engineering talent.

Location: Mountain View, California or San Francisco, California

Salary: $228,600 — $317,233 USD

Company

Databricks is the data and AI company providing a Data Intelligence Platform to unify data, analytics, and AI for over 10,000 organizations worldwide.

What you will do

• Lead the engineering team building next-generation ETL features for the Databricks Lakeflow platform.
• Spearhead Agentic Data Engineering infrastructure for pipeline authoring, execution, and maintenance.
• Oversee sustained recruitment and upskilling of top-tier engineering talent.
• Develop processes to implement product vision and strategy according to organizational goals.
• Manage long-term technical architecture decisions and balance the product roadmap against technical debt.
• Ensure the team builds high-quality, reliable infrastructure that is easy to operate.

Requirements

• Minimum 3 years of experience in managing top-tier engineering teams.
• 5+ years of experience building data infrastructure systems such as Apache Spark or database internals.
• Deep passion and expertise in distributed systems, storage systems, or performance optimization.
• Proven track record in attracting, hiring, and coaching engineers to meet high hiring standards.
• Experience managing SLAs, testing, and quality for complex technical domains.
• Ability to work with product management and customers to translate needs into technical requirements.

Culture & Benefits

• Comprehensive benefits and perks tailored to the employee's region.
• Commitment to a diverse and inclusive culture where everyone can excel.
• Opportunity to work on one of the world's largest data engineering platforms processing exabytes of data.