Senior Data Engineer (Azure/Databricks)

id 124766
Data Engineer
Senior
"Customer location: United Kingdom
Candidates locations: EU
Working time - BST
Language: English B1+
Estimated start date: 14.09.2026
Duration: 12 months"

Project Responsibilities

Design, develop and operationalise scalable data engineering solutions for the Sunrise programme.
Contribute to the design and implementation of the EDAM (Enterprise Data & Analytics Mesh) platform.
Design and implement robust data ingestion pipelines from Sapiens, IRIS and other enterprise source systems.
Develop scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and Microsoft Fabric.
Build and maintain data solutions across Azure Data Lake and modern cloud data platforms.
Implement medallion architecture and reusable data engineering patterns.
Develop curated datasets, analytical data products and trusted business views.
Implement data transformation, cleansing, validation and reconciliation processes.
Support source-to-target data migration and integration activities.
Work closely with Business Analysts, Data Analysts, Data Architects and other engineering teams to translate requirements into production-ready data solutions.
Ensure data pipelines and data products meet requirements for scalability, reliability, performance, security and data quality.
Implement automated data quality and validation checks across pipelines and datasets.
Support regulatory and operational reporting capabilities and ensure data is accurate, complete and traceable.
Implement monitoring, logging and operational controls for data pipelines and platform services.
Contribute to CI/CD and DevOps practices using Azure DevOps.
Implement infrastructure and engineering automation where appropriate.
Develop reusable frameworks, components and engineering standards to accelerate delivery across the programme.
Contribute to data governance, lineage, metadata and security requirements.
Work with platform and architecture teams to ensure EDAM solutions align with enterprise architecture and governance standards.
Leverage AI-assisted and agentic AI tooling to improve development, testing, documentation and delivery productivity.
Explore and implement AI-enabled approaches to data engineering and SDLC automation.
Support the development of data foundations required for future AI and agentic AI use cases.
Participate in technical design, code reviews, troubleshooting and production support activities.
Mentor other engineers and contribute to engineering best practices within the Data Team.

Candidate's Portrait

Location - only EU
Working time - BST

We are looking for a Senior Data Engineer to play a key role in designing, building and operationalising the modern data platform. The role combines advanced data engineering, cloud technologies and AI-enabled engineering practices, with a strong focus on Azure, Databricks and Microsoft Fabric.