Назад
Company hidden
7 дней назад

Lead Data Engineer (Databricks/Azure)

Формат работы
onsite
Тип работы
fulltime
Грейд
lead
Английский
b2
Страна
UK
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead Data Engineer (Databricks/Azure): Designing and delivering scalable, secure data platforms, pipelines, and products across business domains with an accent on technical leadership, data governance, and operational reliability. Focus on building batch and real-time processing architectures, optimizing Spark and Azure services, and driving data quality, observability, CI/CD, and engineering standards.

Location: Southampton or London, United Kingdom

Company

hirify.global is a wealth management business providing financial advice, investment platforms, multi-asset investment solutions, and discretionary fund management.

What you will do

  • Provide technical leadership and domain ownership across data engineering initiatives.
  • Design and deliver scalable data pipelines, data products, and platform capabilities using modern data engineering practices.
  • Translate business and product requirements into technical designs and implementation plans.
  • Drive automation, testing, CI/CD, source control, observability, and infrastructure-as-code adoption.
  • Mentor data engineers through coaching, technical reviews, pair programming, and knowledge sharing.
  • Improve data quality, security, governance, reliability, monitoring, incident management, and regulatory compliance.

Requirements

  • Degree in computer science, engineering, mathematics, physics, or an equivalent level of practical experience.
  • Proven experience as a senior or lead data engineer in a complex enterprise environment delivering large-scale data solutions.
  • Strong hands-on experience designing, developing, and supporting Databricks-based data platforms and pipelines within Azure.
  • Experience with batch and real-time processing, event-driven systems, streaming architectures, and data products.
  • Experience implementing data quality frameworks, SLOs, data contracts, observability tooling, governance, lineage, metadata, cataloguing, security, and access controls.
  • Experience meeting GDPR, data retention, information security, and other regulatory and organisational requirements.
  • Ability to define and adopt engineering standards, patterns, and best practices; conduct code reviews; and mentor engineers.
  • Strong data modelling experience across architectural layers, including Kimball dimensional modelling, Data Vault, medallion architecture, and lakehouse design.
  • Experience working in Agile teams with architects, product owners, analysts, platform teams, and business stakeholders, plus strong technical communication and problem-solving skills.
  • Advanced Python and SQL skills; deep Spark knowledge covering distributed computing, internals, optimization, and performance tuning.
  • Knowledge of Databricks Delta Lake, Unity Catalog, Workflows, Asset Bundles, Notebooks, Compute Management, Delta Live Tables, Spark Declarative Pipelines, and platform optimization.
  • Knowledge of Microsoft Fabric, including Lakehouse, Data Warehouse, Real-Time Intelligence, Semantic Models, and administration concepts.
  • Experience with Azure ADLS Gen2, Azure Data Factory, Key Vault, Functions, Azure Monitor, and other Azure data services.
  • Experience with Azure DevOps, Git-based workflows, infrastructure as code, automated testing, deployment automation, and enterprise orchestration frameworks.

Nice to have

  • Scala experience.

Culture & Benefits

  • Permanent full-time role within the Chief Data Office, reporting to the Data Engineering Manager.
  • Culture focused on integrity, curiosity, continuous learning, inclusion, collaboration, ownership, and engineering excellence.
  • 182 hours of annual holiday, equivalent to 26 days.
  • Employee incentive scheme and non-contributory pension scheme with optional personal contributions.
  • Private medical insurance, life assurance at four times salary, and income protection at 75% of salary after 26 weeks of absence.
  • Additional flexible benefits are available to UK employees through salary deduction.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →