Senior Databricks Data Engineer (AI)

TL;DR

Senior Databricks Data Engineer (Databricks/Spark): Designing and building large-scale data platforms on Databricks for analytics and AI with an accent on scalable data pipelines and lakehouse patterns. Focus on optimizing Databricks workloads, implementing Delta Lake transformations, and ensuring data quality for advanced AI consumption.

Location: Hybrid (Belgium), 70% remote

Company

hirify.global is a technology services provider part of the Capgemini Group, focusing on driving business value through AI, data, and automation for organizations requiring rapid innovation.

What you will do

• Design and implement scalable data pipelines using Databricks and Spark.
• Develop transformation patterns leveraging PySpark and SQL.
• Apply Lakehouse and Delta Lake patterns for reliable data processing.
• Optimize the performance, stability, and cost of Databricks workloads.
• Collaborate with architects and engineering teams on platform design choices.
• Ensure data availability and quality for analytics and AI use cases.

Requirements

• Strong senior-level experience as a data engineer working with Databricks.
• Hands-on experience with Spark and PySpark in production environments.
• Proficiency in Databricks Lakehouse concepts and Delta Lake.
• Strong knowledge of SQL and data modeling concepts.
• Professional working proficiency in English and Dutch is required.

Nice to have

• Experience with performance tuning and cost optimization on Databricks.
• Experience in regulated or enterprise environments.
• Consulting or customer-facing experience.
• Knowledge of French.

Culture & Benefits

• Hybrid work model allowing 70% remote work and a flex abroad program (up to 45 days).
• Company car or mobility budget options.
• Comprehensive health insurance and pension plan.
• Meal vouchers and eco vouchers starting from €250/year.
• Flex plan for purchasing extra days off or home office supplies.
• Generous leave policy with 32 vacation days.