Data Engineer Lead (Azure)

id 125339
Data Engineer
Lead

Project Responsibilities

Lead the design, development and operationalisation of scalable data engineering solutions for the Sunrise programme.
Own the technical direction of data engineering initiatives and contribute to the design and implementation of the EDAM (Enterprise Data & Analytics Mesh) platform.
Define and evolve data engineering architecture, patterns and standards across the EDAM ecosystem.
Design and implement robust data ingestion pipelines from Sapiens, IRIS and other enterprise source systems.
Develop scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and Microsoft Fabric.
Build and maintain data solutions across Azure Data Lake and modern cloud data platforms.
Implement medallion architecture, reusable frameworks and data engineering patterns.
Develop curated datasets, analytical data products and trusted business views.
Lead data transformation, cleansing, validation, reconciliation, migration and integration activities.
Work closely with Business Analysts, Data Analysts, Data Architects and engineering teams to translate requirements into production-ready solutions.
Act as a technical point of contact for complex data engineering topics and provide guidance on solution design and implementation.
Ensure data solutions meet requirements for scalability, reliability, performance, security, maintainability and data quality.
Define and implement automated data quality, validation and reconciliation frameworks.
Support regulatory and operational reporting, ensuring data is accurate, complete and traceable.
Implement monitoring, logging, alerting and operational controls for data pipelines and platform services.
Drive CI/CD, DevOps and engineering automation practices using Azure DevOps.
Identify and manage technical risks, dependencies and delivery bottlenecks across data engineering workstreams.
Ensure EDAM solutions align with enterprise architecture, governance, security and operational standards.
Contribute to data governance, lineage, metadata and security requirements.
Leverage AI-assisted and agentic AI tooling to improve development, testing, documentation and SDLC productivity.
Support the development of data foundations required for future AI and agentic AI use cases.
Lead technical design sessions, code reviews, troubleshooting and production support activities.
Establish engineering best practices and technical standards across the Data Team.
Mentor Data Engineers and support the development of engineering capabilities within the team.
Evaluate new technologies and approaches and drive continuous improvement of the data platform.

Candidate's Portrait

Location - only EU
Working time - BST

We are looking for a Senior Data Engineer to play a key role in designing, building and operationalising the modern data platform. The role combines advanced data engineering, cloud technologies and AI-enabled engineering practices, with a strong focus on Azure, Databricks and Microsoft Fabric.