Назад
Company hidden
4 часа назад

Data Engineer (Databricks)

Формат работы
onsite
Тип работы
project
Грейд
senior
Английский
b2
Страна
UK
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Engineer (Databricks): Designing, building, securing, automating, and operating enterprise Databricks Lakehouse platforms for banking and financial services clients with an accent on scalability, reliability, governance, and performance. Focus on provisioning multi-environment platforms, automating infrastructure with Terraform and CI/CD, implementing Unity Catalog and security controls, and integrating Databricks with AWS services.

Location: Manchester, England, GB

Company

hirify.global is recruiting for a technology contract focused on enterprise data platforms for banking and financial services clients.

What you will do

  • Build and manage enterprise Databricks Lakehouse platforms across Development, Test, UAT, and Production environments.
  • Provision and configure Databricks workspaces, clusters, compute resources, and platform settings.
  • Automate infrastructure provisioning and platform configuration with Terraform and Infrastructure as Code.
  • Develop and maintain CI/CD pipelines for Databricks deployments, notebooks, jobs, and configurations.
  • Administer Unity Catalog and implement RBAC, service principals, secrets management, and least-privilege access.
  • Integrate Databricks with AWS and Azure services, monitor platform health, troubleshoot production issues, and optimise cost, performance, and reliability.

Requirements

  • Strong hands-on experience with Databricks, including Notebooks, PySpark, SQL, Delta Lake, Jobs, Workflows, and Declarative Pipelines.
  • Experience with Unity Catalog, Databricks Auto Loader, Structured Streaming, and batch and incremental data pipelines.
  • Strong understanding of Lakehouse architecture, including Bronze, Silver, and Gold layers.
  • Good knowledge of AWS services, particularly S3, IAM, KMS, Glue, and Lambda.
  • Experience migrating data workloads from AWS-native services to Databricks.
  • Understanding of cloud infrastructure, security, networking, and identity management.
  • Experience with Git, CI/CD pipelines, and deployment automation.
  • Strong understanding of distributed data processing, data modelling, and performance optimisation.

Nice to have

  • Knowledge of Terraform or Infrastructure as Code.

Culture & Benefits

  • Contract engagement in the Technology discipline.
  • Collaboration with Data Engineering, Cloud, DevOps, Security, and Governance teams.
  • Work focused on secure, scalable, governed platforms for banking and financial services clients.

Hiring process

  • Apply if the position is of interest.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →