Назад
Company hidden
5 часов назад

Data Architect (Databricks)

Формат работы
onsite
Тип работы
project
Грейд
senior
Английский
b2
Страна
UK
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Architect (Databricks): Building, securing, automating, and operating enterprise Databricks Lakehouse platforms for banking and financial services clients with an accent on infrastructure provisioning, CI/CD, Unity Catalog, and secure multi-environment operations. Focus on integrating Databricks with AWS, optimizing distributed workloads, supporting batch and incremental pipelines, and maintaining reliable multi-region platform configurations.

Location: London, England, GB

Company

hirify.global is recruiting for a technology contract focused on enterprise Databricks Lakehouse platforms.

What you will do

  • Build, configure, and maintain enterprise Databricks Lakehouse platforms across Dev, Test, UAT, and Production environments.
  • Provision workspaces, compute resources, cluster policies, job clusters, and platform settings using Terraform or Infrastructure as Code.
  • Develop CI/CD pipelines for platform configurations, notebooks, jobs, and application deployments.
  • Configure Unity Catalog, RBAC, service principals, secrets management, and least-privilege access.
  • Integrate Databricks with AWS or Azure services and support multi-environment, multi-region deployments.
  • Monitor, troubleshoot, secure, document, and optimize platform operations for reliability, performance, and cost efficiency.

Requirements

  • Strong hands-on experience with Databricks Notebooks, PySpark DataFrame API, SQL transformations, Delta Lake, Databricks Jobs, Job Flows, Workflows, and Declarative Pipelines.
  • Experience with Unity Catalog, Databricks Autoloader, Structured Streaming, and both batch and incremental pipelines.
  • Terraform or Infrastructure as Code experience for Databricks configuration is listed as optional.
  • Strong familiarity with AWS S3, IAM, KMS, Glue, and Lambda.
  • Experience migrating workloads from AWS native tools to Databricks.
  • Knowledge of distributed data processing, performance tuning, Lakehouse medallion architecture, and bronze-to-silver-to-gold data modeling.
  • Experience with Git and CI/CD.

Culture & Benefits

  • Contract position within the Technology discipline.
  • Work includes collaboration with Data Engineering, Cloud, DevOps, Security, Governance, and Application teams.
  • Responsibilities include supporting security and governance requirements for banking and financial-services environments.

Hiring process

  • Apply if the position is of interest.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →