Назад
Company hidden
4 часа назад

Senior Databricks Engineer (Financial Services)

500GBP
Формат работы
onsite
Тип работы
project
Грейд
senior
Английский
b2
Страна
UK
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Databricks Engineer (Financial Services): Building and operating enterprise-scale Databricks Lakehouse platforms and batch and incremental data pipelines with an accent on PySpark, SQL, Delta Lake, AWS integration, and secure multi-environment deployments. Focus on migrating AWS-native workloads, optimizing distributed data processing, automating platform delivery, and supporting governance and production reliability.

Location: London or Manchester, UK; 3 days per week onsite

Salary: £500 GBP/day, Inside IR35

Company

hirify.global is recruiting for a large-scale enterprise data engineering programme for a leading financial services client.

What you will do

  • Develop and maintain Databricks Lakehouse solutions across Development, Test, UAT, and Production environments.
  • Build batch, incremental, streaming, and Auto Loader pipelines using PySpark, SQL, Delta Lake, and medallion architecture.
  • Configure Databricks workspaces, compute resources, clusters, Jobs, Workflows, Declarative Pipelines, and platform deployments.
  • Integrate Databricks with AWS services including S3, IAM, KMS, Glue, and Lambda, including migration from AWS-native tools.
  • Implement CI/CD, Git-based source control, infrastructure automation, monitoring, alerting, security controls, and Unity Catalog governance.
  • Collaborate with Data Engineering, Cloud, DevOps, Security, Application, and Governance teams to deliver reliable, scalable, high-performance data platforms.

Requirements

  • Strong hands-on experience with Databricks, Databricks Notebooks, PySpark DataFrame API, SQL transformations, Delta Lake, Jobs, Job Flows, and Workflows.
  • Experience with Declarative Pipelines, including DPX files and pipeline definitions, Unity Catalog, Auto Loader, and Structured Streaming.
  • Experience building batch and incremental data pipelines, distributed data processing, performance tuning, and Lakehouse Bronze, Silver, and Gold layers.
  • Experience with AWS S3, IAM, KMS, Glue, and Lambda, including migration of AWS-native workloads to Databricks.
  • Experience with Git and CI/CD for Databricks notebooks, jobs, and deployments.
  • Approximately 7–10 years of relevant experience in enterprise data engineering and Databricks.
  • Experience with enterprise-scale data platforms and understanding of secure, governed, multi-environment deployments.
  • Must be comfortable working onsite 3 days per week in London or Manchester.

Nice to have

  • Terraform and Infrastructure as Code experience.
  • Enterprise Databricks platform configuration experience.
  • Multi-environment and multi-region deployment experience.
  • Financial services or banking domain experience.
  • Knowledge of platform security, monitoring, governance, and production Databricks support.

Culture & Benefits

  • Contract engagement lasting 4 months or longer.
  • Work within a large-scale enterprise financial services data engineering programme.
  • Cross-functional collaboration with engineering, cloud, DevOps, security, application, and governance teams.
  • Inside IR35 contract arrangement.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →