Data Engineer (AI)

TL;DR

Data Engineer (PySpark/Databricks): Building and scaling the data infrastructure for an AI-driven marketing platform with an accent on clean pipelines and data quality. Focus on optimizing distributed clusters in Databricks and designing scalable databases to support millions of daily sessions.

Location: Must be living in the Netherlands; hybrid work (3 days in office). No IND sponsorship provided.

Company

hirify.global is the first fully operational AI Digital Marketing Partner, designed to automate data management and repetitive tasks for marketers.

What you will do

• Design, improve, and scale core data pipelines using PySpark to handle millions of daily sessions.
• Optimize distributed cluster setups within Databricks to improve performance and reliability.
• Develop frameworks for data validation, quality checks, and write comprehensive unit tests.
• Contribute to the design and scaling of the central database for the core application.
• Collaborate with data scientists and full-stack developers to solve architectural challenges and fix bugs.

Requirements

• 2-5 years of professional experience as a Data Engineer.
• 2-5 years of experience with Python and pandas.
• 2+ years of experience designing and building scalable data pipelines.
• 1.5+ years of solid hands-on experience with PySpark.
• Experience with Databricks and/or Delta Lake.
• Fluent in English.

Culture & Benefits

• Hybrid workspace located in the heart of Amsterdam.
• 25 holiday days plus your birthday off.
• MacBook provided.
• Access to OpenUp for mental health and wellbeing support.
• A lightweight process environment that favors direct collaboration over heavy Scrum rituals.
• One volunteering day per year and daily lunch provided.