Senior Data Engineer (Medtech)

TL;DR

Senior Data Engineer (Medtech): Architecting a scalable lakehouse by migrating workloads to Apache Iceberg, developing a Jobs API, and building Spark/Flink pipelines with an accent on robust batch and streaming data pipelines. Focus on the establishment of formal data contracts and the development of a unified lineage and governance framework.

Location: Candidates must possess a valid EU visa and be based in Portugal. No relocation assistance provided.

Salary: €39,545 - €62,142 a year

Company

hirify.global is shifting healthcare from human-first to AI-first through its AI Care platform.

What you will do

• Spearhead the migration of existing workloads to the Iceberg format.
• Architect and construct robust batch and streaming data pipelines utilizing Spark and Flink technologies.
• Collaborate with the Backend Engineering team on API integrations and the establishment of formal data contracts.
• Contribute to the development of a unified lineage and governance framework utilizing DataHub.
• Provide support to the Core Team in the successful adoption of new data platform capabilities.

Requirements

• Demonstrated proficiency with Python and PySpark.
• Hands-on experience with data lake formats (e.g., Iceberg, Delta Lake, or Hudi).
• Solid understanding of Kafka and event-driven architectures.
• Experience in building and orchestrating data pipelines at scale.
• Strong SQL proficiency and comprehensive data modeling knowledge.
• Familiarity with workflow orchestration tools (e.g., Airflow, Dagster, or similar).

Nice to have

• Demonstrated expertise with Flink or comparable streaming frameworks.
• Proficiency in DBT and familiarity with the modern data stack.
• Experience with modern data platforms such as BigQuery, Trino, Snowflake, or Databricks.
• Proven background in developing self-service data platforms.

Culture & Benefits

• Stimulating, fast-paced environment with lots of room for creativity.
• Career development and growth, with a competitive salary.
• Opportunity to work with a talented team.
• Flexible environment where you can control your hours (remotely) with unlimited vacation.
• Remote or Hybrid work policy.
• Access to our health and well-being program (digital therapist sessions).