Senior Data Engineer (Databricks/Healthcare)

Location: Remote/Hybrid in the United States; the role is preferably based in Boston, MA, with the position also listed in Nashville, TN. Occasional travel to hirify.global offices may be required.

Salary: $117,600–$161,700 per year, plus eligibility for a bonus incentive plan.

Company

hirify.global is a U.S. healthcare and insurance company providing healthcare and related services to millions of members.

What you will do

• Design, build, and maintain Bronze, Silver, and Gold Databricks Lakehouse pipelines for healthcare, member, clinical, engagement, behavioral, and socioeconomic data.
• Develop Gold-layer feature tables and reusable data products for model training, scoring, reinforcement learning, and real-time decisioning.
• Build batch and streaming ingestion pipelines using Spark, Delta Lake, Databricks, and event-driven architectures.
• Implement data quality validation, reconciliation, monitoring, alerting, testing, lineage, security, and PHI-compliance controls.
• Optimize Spark workloads, storage, partitioning, query performance, scalability, and cost.
• Partner with Data Science, AI Engineering, Decision Intelligence, and Platform Engineering teams while supporting production incidents and pipeline reliability.

Requirements

• Bachelor’s degree in computer science or a related field.
• 5+ years of experience building and operating production data platforms.
• Strong SQL and Python skills with hands-on Spark-based data pipeline development.
• Experience with Databricks, Delta Lake or comparable lakehouse platforms, Medallion Architecture, and batch and streaming processing.
• Strong knowledge of data modeling, pipeline testing, data quality controls, distributed systems, cloud data platforms, and operational support.
• Ability to work remotely or in a hybrid arrangement in the United States; occasional office travel may be required.

Nice to have

• Experience with Databricks Feature Store, Unity Catalog, Delta Live Tables, Databricks Workflows, Spark Structured Streaming, Kafka, or real-time feature engineering.
• Experience with Azure Data Factory, Azure Data Lake Storage, Azure Event Hubs, Great Expectations, Monte Carlo, or similar tools.
• Familiarity with machine learning, recommendation systems, reinforcement learning, decision intelligence, or AI development tools.
• Experience integrating healthcare, claims, CMS, CDC, consumer, or social determinants of health datasets.
• Background in healthcare, insurance, or another regulated industry involving PHI and HIPAA requirements.

Culture & Benefits

• Remote/hybrid work with typical Monday–Friday business hours and a 40-hour workweek.
• Dedicated home workspace and internet service with at least 25 Mbps download and 10 Mbps upload required for home or hybrid work.
• Medical, dental, and vision insurance, 401(k), paid time off, holidays, parental and caregiver leave, disability coverage, and life insurance.
• Work requires protecting member PHI and HIPAA information in the home or office environment.
• Very limited travel may be required for training, meetings, or conferences.

Hiring process

• Selected candidates complete a 10–15-minute on-demand HireVue assessment with predetermined questions.
• Candidates who pass the assessment proceed to subsequent interviews.
• Following a formal offer, SSN information is requested through Workday for duplicate-profile screening.