Senior Data Engineer (Python)

TL;DR

Senior Data Engineer (Python): Building and maintaining modular ETL pipelines for financial services with an accent on Apache Spark and Azure Databricks. Focus on designing robust schema logic, optimizing data transformation flows, and ensuring system scalability within Azure CI/CD environments.

Location: Must be based in or able to work from Amsterdam

Company

A professional solutions provider connecting skilled professionals with international and local projects since 2000, operating from Amsterdam and London.

What you will do

• Build and maintain high-performance ETL pipelines using Python and Apache Spark.
• Design complex transformation logic and modular schema architectures.
• Integrate data pipelines within Azure DevOps CI/CD workflows.
• Collaborate on orchestration tasks using Apache Airflow or Azure Durable Functions.
• Participate in architectural discussions to support downstream reporting and risk systems.
• Ensure high code quality through rigorous unit and integration testing.

Requirements

• 5+ years of experience in professional data engineering roles.
• Strong expertise in Python development and Apache Spark/PySpark.
• Solid understanding of SQL, relational database design, and data processing patterns.
• Hands-on experience with Azure Databricks and Azure DevOps CI/CD pipelines.
• Ability to work onsite in Amsterdam.

Culture & Benefits

• Opportunity to work on diverse projects ranging from startups to global players.
• Engagement in a long-standing international professional network.
• Access to modern engineering environments and specialized toolsets.
• Project-based contract flexibility.