Staff Data Engineer (Azure Databricks)

TL;DR

Staff Data Engineer (Azure/Databricks): Design, develop, and maintain enterprise-scale data infrastructure for unified data platform with an accent on robust data pipelines, workflow optimization, and data quality governance. Focus on scalable ETL/ELT frameworks, performance tuning, and cross-functional collaboration for data-driven decisions.

Location: Hybrid working mode in the United States (US); office 3 days/week (Tue-Thu) if near hubs in Chicago, IL; Boston, MA; South Bend, IN; remote otherwise within US. US-based jobs.

Salary: $110,000–$170,000 base + discretionary bonus.

Company

Leading experience measurement, data analytics, and insights provider for complex industries with roots in U.S. healthcare, serving global clients across sectors.

What you will do

• Design, build, and optimize data pipelines/workflows in Azure/Databricks, integrating Data Lake and SQL databases.
• Implement scalable ETL/ELT frameworks using Azure Data Factory, Databricks, and Spark.
• Optimize data structures/queries for performance, reliability, cost; drive data quality/governance including metadata/validation.
• Collaborate with analytics, data science, business teams to define/implement data models.
• Maintain documentation, enforce best practices, support CI/CD with GitLab/Azure DevOps.
• Mentor juniors, publish curated datasets to Power BI, ensure security/compliance/privacy.

Requirements

• 7+ years data engineering experience, significant hands-on in Azure cloud data platforms.
• Advanced Azure (5+ years: Data Lake, ADF, SQL); strong Databricks/Spark/Delta Lake (5+ years each).
• Proficient SQL (10+ years), Python (5+ years); data modeling, governance, metadata management.
• Source control (Git), CI/CD, DevOps practices; analytical/problem-solving skills.
• Bachelor’s/Master’s in CS/Data Science/related; lead projects, mentor engineers, communication skills.
• US-based; hybrid if near hubs.

Nice to have

• Real-time/streaming pipelines.
• Scala familiarity.
• Power BI.
• Master’s degree.
• ML integration in pipelines.

Culture & Benefits

• Collaborative culture valuing human experience, innovation, learning, ownership.
• Hybrid US model with office hubs; work from home flexibility.
• Competitive benefits package, base salary + bonus tied to results.
• Continuous improvement, team success, diverse/inclusive workplace.
• Trusted advisor to global brands; path of learning and growth.