Назад
Company hidden
5 дней назад

Middle/Senior Big Data Engineer (Databricks+AWS)

Формат работы
remote (только Poland)/onsite
Тип работы
fulltime
Грейд
middle/senior
Английский
b2
Страна
Poland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Middle/Senior Big Data Engineer (Databricks+AWS): Building scalable batch and streaming data pipelines and cloud-based data solutions on AWS with an accent on Databricks, PySpark, SQL, and Delta Lake. Focus on optimizing large-scale data processing, orchestrating workflows, implementing Kafka and Kinesis streaming solutions, and delivering platforms from PoC and MVP stages to production.

Location: Poland; remote or office work available

Company

hirify.global delivers engineering and technology solutions, including cloud-based data platforms and analytics systems.

What you will do

  • Design, develop, and maintain scalable batch and streaming data pipelines.
  • Build and optimize data processing solutions with Python, PySpark, SQL, Apache Spark, and Databricks on AWS.
  • Develop and manage workflows using Databricks Workflows and Jobs, Apache Airflow, or MWAA.
  • Implement streaming solutions with Apache Kafka, Amazon MSK, or Kinesis.
  • Design and maintain Delta Lake-based data architectures.
  • Collaborate with technical and business stakeholders throughout the project lifecycle, from PoC and MVP stages through production.

Requirements

  • 4+ years of experience in Big Data or Data Engineering.
  • Strong proficiency in Python, PySpark, and SQL.
  • Hands-on experience with AWS data engineering services and Databricks on AWS.
  • Strong knowledge of Apache Spark and large-scale data processing.
  • Experience with batch and streaming data processing, Delta Lake, and workflow orchestration tools.
  • Upper-intermediate or higher English proficiency required.

Culture & Benefits

  • Remote or office work format in Poland.
  • Participation in architecture discussions and continuous improvement initiatives.
  • Cross-functional collaboration across different stages of project delivery.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →