Azure Databricks Data Engineer

Location: London, hybrid — 4 days onsite and 1 day remote

Salary: £450–£550 per day

Company

hirify.global is recruiting for an international digital infrastructure organisation undergoing a major data transformation programme across multiple markets.

What you will do

• Design, develop, and optimise Azure Databricks solutions using PySpark, Python, SQL, and Azure-native technologies.
• Build and maintain enterprise ETL/ELT pipelines for ingestion, transformation, CDC, validation, and data delivery.
• Develop and support Lakeflow pipelines, Delta Lake implementations, and modern data engineering frameworks.
• Improve platform performance, security, governance, monitoring, and reliability.
• Collaborate with architects, engineers, business stakeholders, and technology teams to deliver data products for reporting, analytics, and strategic decision-making.

Requirements

• Proven experience delivering solutions in Azure Databricks environments.
• Strong Python, PySpark, SQL, and T-SQL development skills.
• Experience building large-scale ETL/ELT pipelines and cloud-based data platforms.
• Knowledge of Delta Lake, Unity Catalog, data governance, and medallion architecture.
• Experience with REST APIs, JSON, Azure Data Factory, ADLS, Key Vault, Git, CI/CD, deployment automation, and production support.
• Strong troubleshooting, performance tuning, optimisation, stakeholder engagement, and communication skills.

Nice to have

• Exposure to Microsoft Fabric.
• Databricks certifications.
• Experience with Terraform and infrastructure-as-code practices.
• Experience in large, international, or regulated environments.

Culture & Benefits

• Six-month initial contract within a long-term data transformation programme.
• Opportunity to influence a core enterprise data platform.
• Work on complex data challenges supporting operational performance and strategic growth.
• Contract is inside IR35.