Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks/PySpark): Designing and implementing scalable ETL/ELT pipelines and a modern enterprise Data Lake with an accent on performance optimization and AI-driven automation. Focus on leveraging AI coding assistants to accelerate development and building robust ingestion frameworks for high-volume data.

Location: Remote (Must be based in the United States, with a preference for California)

Salary: $152,000 - $190,000 USD

Company

The world’s leading live entertainment and eCommerce company, comprising Ticketmaster, Live Nation Concerts, Front Line Management Group, and Live Nation Network.

What you will do

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
• Optimize data workflows and Spark queries for performance, cost efficiency, and reliability.
• Build robust ingestion frameworks, transformation logic, and reusable components for the enterprise Data Lake.
• Integrate AI coding copilots (GitHub Copilot, Databricks Assistant) to accelerate development, code review, and documentation.
• Leverage AI to auto-detect pipeline anomalies, data drift, and quality issues.
• Collaborate with product teams and mentor junior engineers within an Agile framework.

Requirements

• 5–7+ years of hands-on data engineering experience.
• Advanced proficiency in Python, SQL, and PySpark.
• Strong experience with Databricks and distributed data processing.
• Proven ability to use AI development tools (GitHub Copilot, IDE AI copilots) to optimize workflows.
• Solid understanding of data modeling, governance, and CI/CD for data pipelines.
• Must be based in the United States.

Culture & Benefits

• Comprehensive health, vision, and dental benefits, including FSA and HSA.
• 401(k) program with company match and stock program.
• Generous paid time off, including sick time and birthday leave.
• Unique perks like free concert tickets and tuition reimbursement.
• Support for families, including new parent programs, caregiver leave, and childcare cash.
• Inclusive environment with volunteer time off and professional development programs.