Lead Data Engineer (Databricks)

Location: Southampton or London, United Kingdom

Company

hirify.global is a wealth management business providing financial advice, investment platforms, multi-asset investment solutions, and discretionary fund management across the UK, Ireland, and Channel Islands.

What you will do

• Provide technical leadership and domain ownership across one or more enterprise data domains.
• Design and deliver scalable data pipelines, data products, and platform capabilities using modern data engineering practices.
• Translate business and product requirements into technical designs, implementation plans, and delivery roadmaps.
• Define engineering standards and promote automation, testing, CI/CD, source control, observability, and infrastructure-as-code.
• Ensure data products meet standards for reliability, performance, security, governance, data quality, and regulatory compliance.
• Coach and mentor data engineers through technical reviews, pair programming, knowledge sharing, and communities of practice.

Requirements

• Experience as a senior or lead data engineer in a complex enterprise environment delivering large-scale data solutions.
• Strong hands-on experience with Databricks and Azure, including Delta Lake, Unity Catalog, Workflows, Delta Live Tables, ADLS Gen2, Azure Data Factory, Key Vault, Functions, and Azure Monitor.
• Experience designing batch and real-time processing solutions, event-driven and streaming architectures, and distributed Spark workloads.
• Advanced Python and SQL skills; experience with Scala is beneficial.
• Experience with data quality frameworks, data contracts, SLOs, observability, governance, lineage, metadata, cataloguing, security, access controls, GDPR, and data retention.
• Knowledge of Kimball dimensional modelling, Data Vault, medallion architecture, lakehouse design, Agile delivery, CI/CD, DevOps, and infrastructure-as-code.

Culture & Benefits

• Permanent role within the Chief Data Office, reporting to the Data Engineering Manager.
• 26 days of holiday, equivalent to 182 hours.
• Company incentive scheme and non-contributory pension scheme with options for additional personal contributions.
• Private medical insurance, life assurance at four times salary, and income protection at 75% of salary after 26 weeks of absence.
• Flexible benefits are available to UK employees through salary deduction.
• Inclusive culture focused on integrity, curiosity, continuous learning, collaboration, ownership, and engineering excellence.