Senior Data Engineer (Healthcare AI)

TL;DR

Senior Data Engineer (PySpark/AWS): Building and deploying data services that power an AI-driven healthcare platform with an accent on clinical data ingestion and infrastructure scalability. Focus on optimizing Spark workloads, designing robust data models, and ensuring high data quality for ML and analytics workflows.

Location: Must be based in or be able to relocate to the New York City, Los Angeles, or San Francisco metro areas. Must be authorized to work in the US without visa sponsorship.

Salary: $165,000 – $220,000 + Equity

Company

hirify.global is an AI-powered Proactive Documentation platform designed to improve healthcare delivery by automating clinical documentation within the EHR.

What you will do

• Design, develop, and deploy data services and infrastructure powering the hirify.global platform.
• Build and evolve data models and pipelines to transform clinical data for downstream product and ML workflows.
• Optimize Spark workloads and partitioning strategies to manage costs and performance.
• Collaborate with engineering teams to enforce rigorous data quality standards and ensure trustworthy datasets.
• Partner with product teams to deliver actionable insights and analytics to stakeholders.
• Manage the reliability and operational health of the data platform through monitoring and alerting.

Requirements

• 5+ years of experience in data engineering roles.
• 3+ years of experience with PySpark and public cloud technologies (specifically AWS S3, EMR, or Athena).
• Strong proficiency in Python and SQL.
• Experience in data modeling and pipeline design across the full data stack.
• Authorized to work in the US without visa sponsorship.
• Ability to work hybrid in NYC, LA, or SF (in-office Tuesdays and Thursdays).

Nice to have

• Experience with Apache Iceberg, Dagster, Clickhouse, PostgreSQL, FastAPI, or Metabase.
• Experience with healthcare data, including HIPAA compliance, OMOP CDM, and data de-identification.
• Experience building pipelines for ML workflows, including model training, validation, and deployment.

Culture & Benefits

• 99% employer-paid health benefits (Medical, Dental, and Vision) plus a One Medical subscription.
• 18 PTO days per year and a one-week holiday break.
• Equity eligibility and a sabbatical program.
• Monthly health and wellness budget.
• Company-sponsored team retreats and social events.
• Hybrid flexibility allowing up to 6 weeks of remote work from outside the home office per year.