Назад
Company hidden
5 дней назад

Senior Data Consultant (Hadoop, Spark)

125 - 163PLN
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Poland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Consultant (Hadoop, Spark) (Hadoop/Spark): Designing, developing, and maintaining scalable data solutions and pipelines in an Agile DevOps environment with an accent on PySpark, Hadoop ecosystem components, automated testing, and data modelling. Focus on building high-performance data systems, implementing monitoring and scalability tools, troubleshooting production issues, and contributing to system architecture.

Location: Kraków, Poland; hybrid work with 2 days per week from the client's office

Salary: 125–163 PLN net/hour

Company

hirify.global provides technology consulting and software development services.

What you will do

  • Design, develop, and maintain scalable data solutions using PySpark and Hadoop components.
  • Build and maintain data pipelines, automation, monitoring, and performance tools.
  • Automate testing, perform code reviews, mentor developers, and promote development standards.
  • Provide production support, debug issues, and communicate findings to development teams.
  • Collaborate with Engineers, Data Analysts, and Business Analysts to interpret and implement requirements.
  • Contribute to system architecture, Agile planning, sprint reviews, and retrospectives.

Requirements

  • Experience with PySpark or Scala development and software design.
  • Experience with scheduling tools such as Airflow and hands-on experience building data pipelines with Hadoop components.
  • Knowledge of the Hadoop ecosystem, including Spark, Hive, YARN, and ETL frameworks.
  • Strong SQL and RESTful services knowledge.
  • Experience working on Unix or Linux platforms.
  • Experience with Git, GitHub, Jenkins, Ansible, and JIRA.
  • Understanding of big data modelling using relational and non-relational techniques.
  • Experience debugging code and communicating findings to development teams.
  • Openness to work 2 days per week from the client's office in Kraków.

Nice to have

  • Experience with Elasticsearch, Java APIs, data ingestion, data integration, and ETL processes.
  • Understanding of cloud design patterns and exposure to DevOps and Agile methodologies such as Scrum and Kanban.
  • Experience with Spark Streaming and Apache Airflow in production.
  • Experience with the Hadoop ecosystem in enterprise environments.
  • Knowledge of Python backend services, Scala for high-performance systems, PL/SQL, and Linux or Unix system operations.

Culture & Benefits

  • B2B contract.
  • Collaborative work with technical and business teams.
  • Agile development process in a DevOps environment.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →