Principal Data Engineer

TL;DR

Principal Data Engineer (Healthcare Data Platform): Architect and build scalable platform foundations including observability, lineage, quality control frameworks with an accent on supporting diverse data formats like EDI, API, JSON and delivering batch/real-time insights. Focus on optimizing Spark/Databricks pipelines, integrating ML/AI models, and defining data strategy with stakeholders.

Location: Hybrid - at least 3 days/week in Dallas, TX

Company

hirify.global is the specialty care platform connecting people with top specialists for surgery, cancer care, infusions and more, delivering excellent care with cost savings to employers and workforces nationwide.

What you will do

• Architect platform foundations ensuring scalability, performance, security, observability, lineage, and quality control.
• Modularize frameworks for diverse data needs, formats (EDI, API, JSON), and batch/real-time insights.
• Collaborate on pipelines and data models with engineers, architects, analysts for reliable, interpretable data.
• Build technical designs, evaluate technologies, lead POCs, champion best practices (CI/CD, code reviews).
• Integrate ML/AI capabilities and evolve platform iteratively for business use cases.
• Partner on data strategy, roadmap, hiring; mentor team, foster high-performance culture.

Requirements

• Bachelor’s or master’s in computer science, engineering or related
• 12+ years Data Engineering, 5+ as Principal Engineer
• 5+ years Python/Scala, deep Spark/Databricks expertise for pipeline optimization
• 3+ years EDI/HIE standards (X12, HL7, FHIR)
• Proven leadership in managing/developing data teams, large-scale infrastructure
• Expertise in cloud, databases, distributed systems (Kafka, NoSQL), data lakes
• Knowledge of AI/ML, OOA/D, N-tier apps, RESTful APIs, data visualizations
• Strong communication for technical concepts to non-technical stakeholders

Nice to have

• Healthcare experience at leading payors/insurers
• Data Governance, Patient Identity management in healthcare
• Robust CI/CD culture with code coverage, unit/integration tests

Culture & Benefits

• Medical, Dental, Vision Insurance
• Short & Long Term Disability, Life Insurance
• 401k with company match
• Flexible Paid Time Off
• Paid Parental Leave
• Emphasis on LIGHT values: Logic, Inclusion, Grit, Humanity, Integrity, Teamwork