Senior Data Engineer

TL;DR

Senior Data Engineer (Databricks): Design, develop, and support data architecture, pipelines, and analytical solutions for healthcare products with an accent on ETL/ELT processes, data lakehouse implementation, and enterprise data strategy. Focus on optimizing performance, ensuring data quality and governance, and integrating diverse data sources using PySpark, Delta Lake, and Unity Catalog.

Remote (USA); hybrid for those near US hub locations in Chicago, IL; Boston, MA; South Bend, IN (3 days/week in office: Tue, Wed, Thu)

$100,000 - $120,000 base + discretionary bonus

Company

Leading provider of experience measurement, data analytics, and insights for healthcare and other complex industries, serving global clients with technology and expertise to improve human experiences.

What you will do

• Create data architecture, pipelines, and analytical solutions for PG-MX Healthcare Products using Databricks (PySpark, Delta Lake, SQL).
• Design and implement Data Lakehouse with Unity Catalog, Delta Live Tables, and Workflows; build ingestion frameworks for structured/unstructured data.
• Optimize clusters, jobs, and queries for performance/cost; implement CI/CD with Git and DevOps tools.
• Develop Master Data Management, person identity solutions, data governance, lineage, and cataloging standards.
• Lead/mentor data engineers, evaluate new technologies, and execute Proofs of Concept.

Requirements

• Minimum 5+ years Data Engineering in enterprise; Bachelor’s in technology or related.
• Hands-on with Azure (Databricks, Data Factory, Synapse), on-prem MS tools (SQL Server, SSIS), AWS familiarity.
• Proficiency in Python, SQL, Spark; experience with relational/NoSQL DBs, data modeling, ETL best practices.
• Skills in data lineage/cataloging (Unity Catalog), Git/DevOps, SQL/Spark optimization.
• Must be US-based or eligible to work in US; excellent problem-solving/communication.

Culture & Benefits

• Collaborative culture emphasizing learning, innovation, ownership, and teamwork (#bettertogether).
• Hybrid work in US hubs (3 office days/week if nearby); competitive benefits package.
• Path of continuous improvement; empower teammates; focus on work-life balance and growth.
• Discretionary bonus/commission; diverse, inclusive workplace committed to EEO.