Назад
Company hidden
18 дней назад

Mid-Level Hadoop Developer (Spark & Scala)

3 780 - 4 410€
Формат работы
hybrid
Тип работы
fulltime
Грейд
middle
Английский
c1
Страна
Portugal/Europe
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Mid-Level Hadoop Developer (Spark & Scala): Developing and optimizing scalable Big Data features for an on-premises Cloudera Hadoop platform supporting a banking Finance and Risk Datalake with an accent on Spark optimization, data architecture, and reliable DevOps delivery. Focus on designing reusable components, managing CI/CD deployments and upgrades, and solving scalability and integration challenges across Hadoop, Kafka, and Scala.

Location: Lisbon, hybrid, with up to two remote days per week. Only candidates with an existing legal right to work in Europe will be considered.

Salary: €3,780–€4,410 for B2B or €2,050–€2,300 net under a permanent contract.

Company

Work for a leading banking group on a Finance and Risk Datalake hosted on an on-premises Cloudera Hadoop Big Data platform.

What you will do

  • Collaborate on the technical design and development of scalable Big Data platform features.
  • Rationalize and reuse components to optimize the data architecture.
  • Participate in code reviews and contribute to code quality.
  • Support test and production deployments in a DevOps context.
  • Manage component upgrades, associated testing, and technical documentation.
  • Participate in Agile ceremonies using Jira and Confluence.

Requirements

  • At least 5 years of experience as a Data Engineer.
  • Strong proficiency in Spark 3, including optimization techniques, and experience with Scala 2.
  • Strong knowledge of the Hadoop ecosystem, including YARN, HDFS, Hive, and Kafka.
  • Experience with CI/CD pipelines, including Jenkins, XL Deploy, and XL Release.
  • Practical knowledge of Bitbucket Git, Jira, and Confluence.
  • Experience with Control-M job scheduling.
  • Fluent English is required.

Nice to have

  • Knowledge of Hadoop security technologies, including Kerberos and Ranger.
  • Experience with a functional programming framework such as ZIO or Cats.

Culture & Benefits

  • Hybrid work model in Lisbon with up to two remote days per week.
  • Work in a collaborative DevOps and Agile environment.
  • Engagement options include B2B or a permanent contract.

Hiring process

  • Submit a CV, preferably in English, together with a statement confirming consent to the processing and storage of personal data.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →