Data Engineer (Databricks)

TL;DR

Data Engineer (Databricks/PySpark): Designing, building, and optimizing scalable data pipelines and analytical data models within Azure, AWS, and Databricks environments with an accent on ETL/ELT processes and Spark optimization. Focus on translating business logic into high-performance curated datasets and ensuring system reliability through robust monitoring.

Location: Hybrid or Remote possibilities to work across hirify.global regions

Company

hirify.global is a leading global affiliate marketing platform and part of the Axel Springer group.

What you will do

• Build and maintain ETL/ELT pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.
• Design curated datasets, semantic layers, and data marts to power business reporting and KPIs.
• Optimize Spark performance (partitioning, caching) and tune PostgreSQL databases for scale and cost.
• Implement data validation, schema enforcement, and operational monitoring using Datadog.
• Collaborate with product owners and analysts to translate business requirements into technical data models.
• Document data models, lineage, and dataset behavior clearly and consistently.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Hands-on experience with Databricks (PySpark, Spark SQL, Delta Lake) and PostgreSQL.
• Proficiency in Python and SQL, with experience in medallion architecture.
• Experience with AWS services, specifically Lambda, CloudWatch, and Step Functions.
• Competence in using Datadog or similar observability platforms.
• Ability to operate in Agile environments and a strong commitment to thorough documentation.

Nice to have

• Experience with BI tools such as Power BI, Tableau, or Luzmo.
• Understanding of CI/CD practices for data pipelines.

Culture & Benefits

• Flexible four-day Flexi-Week at full pay.
• Monthly remote working allowance and a dedicated furniture package for home office setup.
• Comprehensive health, vision, and dental insurance for employees and one family member.
• Meal vouchers and a peer-to-peer appreciation voucher program.
• Inclusive international culture with a virtual ‘Life @ hirify.global’ social hub for global colleagues.