Manager, Test Data Engineering Team (Databricks)

TL;DR

Manager, Test Data Engineering Team (Databricks): Building scalable automated data testing solutions including synthetic data generation, test harnesses, and regression frameworks integrated into deployment pipelines with an accent on data quality platforms, observability, and reliability. Focus on designing reusable validation libraries, establishing monitoring and alerting systems, and driving adoption across global engineering teams.

Location: Work From Home from Georgia, Texas, Louisiana, Florida, or Pennsylvania (US). Willingness to work across time zones and odd hours as necessary.

Company

World’s leading live entertainment company comprised of Ticketmaster, Live Nation Concerts, and Live Nation Media & Sponsorship.

What you will do

• Design and build reusable data quality frameworks integrated into Databricks pipelines, including standardized validation libraries for schema, freshness, volume, and anomaly detection.
• Develop scalable solutions for synthetic data generation, masking, replay frameworks, and automated regression testing for batch and streaming pipelines.
• Establish monitoring, alerting, SLA/SLO frameworks, and tools to track data quality and pipeline health.
• Lead and grow a team of data quality and test data engineers, partnering with Data Engineering, Product, and Analytics teams.
• Define and execute long-term roadmap for enterprise data quality, prioritizing initiatives across global stakeholders.

Requirements

• 5+ years in Data Engineering, Test Data Engineering, or related fields
• 2+ years in a technical leadership or management role
• Strong experience with Databricks, Spark, distributed data systems, Python, and SQL
• Experience building automated validation or data quality frameworks
• Hands-on with data observability tools (e.g., Great Expectations, Deequ, Soda)
• Familiarity with streaming architectures, real-time validation, anomaly detection, and TDD practices
• Experience with JIRA, agile user stories, and managing multiple projects across time zones

Nice to have

• AI orchestration experience for test data practices
• Experience with user behavior data
• Track record launching test data solutions or BI validation applications
• Passion for live music and events

Culture & Benefits

• Health: Medical, vision, dental, mental health benefits, health care concierge, FSA/HSA
• Time off: Generous PTO including holidays, sick time, personal days; free concert tickets
• Wealth: 401(k) with company match, stock reimbursement
• Family: New parent programs, caregiver leave, baby bonuses, fertility/adoption support
• Career: Skill development, tuition reimbursement, student loan repayment
• Other: Volunteer time off, crowdfunding match