Назад
Company hidden
обновлено 6 дней назад

Lead Data Platform Engineer (AWS/Spark)

Формат работы
hybrid
Тип работы
fulltime
Грейд
lead
Английский
b2
Страна
UK
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead Data Platform Engineer (AWS/Spark): Building fraud-data pipelines, data lake components, and producer-side platform capabilities for Experian's Data Analytics Platform with an accent on AWS, Spark, DevSecOps, and secure data governance. Focus on leading a technical team, taking ownership of cloud components, designing scalable pipelines, and mentoring engineers while improving delivery through CI/CD, Infrastructure as Code, and AI-assisted development.

Location: Nottingham, England; hybrid with 40% office attendance

Company

hirify.global is a global data and technology company operating across financial services, healthcare, automotive, agribusiness, insurance, and other markets, with 25,200 employees in 32 countries.

What you will do

  • Lead and support an agile technical team delivering data platform solutions for fraud-related data assets.
  • Guide AWS-based data pipelines, data lake components, and producer-side data platform capabilities.
  • Own the handover, maintenance, enhancement, and support of pipelines and cloud components developed by the central Data Analytics Platform team.
  • Build, test, and maintain high-quality pipelines from Snowflake and internal product and data platforms, including accurate metadata publication to the data catalogue.
  • Champion DevSecOps, CI/CD, Infrastructure as Code, automation, and cloud-native tooling to improve reliability, security, and delivery efficiency.
  • Mentor senior and junior engineers and contribute to technical roadmaps, collaboration, innovation, and learning.

Requirements

  • Strong experience building data pipelines, data lake solutions, or data platform capabilities.
  • Strong AWS data engineering and platform delivery experience, including services such as Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge, and SQS.
  • Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git, and Jenkins.
  • Strong experience developing with Apache Spark or Hadoop.
  • Significant programming experience in Scala or Python.
  • Experience with Configuration as Code principles and API integration.
  • Strong understanding of cloud security, data privacy, access control, and governance in data platform environments.

Nice to have

  • AWS Developer Certification or another relevant AWS certification.
  • Strong Terraform or CloudFormation expertise.
  • Experience with OpenShift or Kubernetes.
  • Experience with automated testing tools such as pytest or Scalatest.
  • Familiarity with SonarQube, Veracode, RESTful APIs, microservice architectures, sensitive or regulated data environments, data catalogues, metadata management, data marketplaces, or federated data mesh concepts.

Culture & Benefits

  • Permanent, full-time employment in a hybrid Nottingham-based role.
  • Compensation package with a discretionary bonus plan.
  • 25 days of annual leave, 8 bank holidays, 3 volunteering days, and the option to purchase additional leave.
  • Pension, Bupa healthcare, Sharesave scheme, and other core benefits.
  • Inclusive, purpose-driven, people-first culture and equal opportunity employment.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →