kafkajenkinshadoopci cdscalayarnsparkhivehdfscontrol m
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
Нижеразвернуть
€45к-53к/год
€46к€66кмедиана€78к
По похожим ролям (41) ~ €66к/год
Прикинули из €3.8к-4.4к/мес × 12
На СНГ рынке: $2.2к/мес ($1.5к - $2.7к)
60
Хорошая вакансия
развернуть
Задачи и платформа описаны чётко, но работа связана с локальной Hadoop-инфраструктурой и оформляется через аутсорсинговую компанию.
Ниже рынка
Устаревающий стек
?Работа на клиентском проекте
Понятные задачи
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Mid-Level Hadoop Developer (Spark & Scala): Developing and optimizing scalable Big Data features for an on-premises Cloudera Hadoop platform supporting a banking Finance and Risk Datalake with an accent on Spark optimization, data architecture, and reliable DevOps delivery. Focus on designing reusable components, managing CI/CD deployments and upgrades, and solving scalability and integration challenges across Hadoop, Kafka, and Scala.
Location: Lisbon, hybrid, with up to two remote days per week. Only candidates with an existing legal right to work in Europe will be considered.
Salary: €3,780–€4,410 for B2B or €2,050–€2,300 net under a permanent contract.
Company
Work for a leading banking group on a Finance and Risk Datalake hosted on an on-premises Cloudera Hadoop Big Data platform.
What you will do
Collaborate on the technical design and development of scalable Big Data platform features.
Rationalize and reuse components to optimize the data architecture.
Participate in code reviews and contribute to code quality.
Support test and production deployments in a DevOps context.
Manage component upgrades, associated testing, and technical documentation.
Participate in Agile ceremonies using Jira and Confluence.
Requirements
At least 5 years of experience as a Data Engineer.
Strong proficiency in Spark 3, including optimization techniques, and experience with Scala 2.
Strong knowledge of the Hadoop ecosystem, including YARN, HDFS, Hive, and Kafka.
Experience with CI/CD pipelines, including Jenkins, XL Deploy, and XL Release.
Practical knowledge of Bitbucket Git, Jira, and Confluence.
Experience with Control-M job scheduling.
Fluent English is required.
Nice to have
Knowledge of Hadoop security technologies, including Kerberos and Ranger.
Experience with a functional programming framework such as ZIO or Cats.
Culture & Benefits
Hybrid work model in Lisbon with up to two remote days per week.
Work in a collaborative DevOps and Agile environment.
Engagement options include B2B or a permanent contract.
Hiring process
Submit a CV, preferably in English, together with a statement confirming consent to the processing and storage of personal data.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →