5 дней назад
Middle/Senior Big Data Engineer (Databricks+AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Middle/Senior Big Data Engineer (Databricks+AWS): Building scalable batch and streaming data pipelines and cloud-based data solutions on AWS with an accent on Databricks, PySpark, SQL, and Delta Lake. Focus on optimizing large-scale data processing, orchestrating workflows, implementing Kafka and Kinesis streaming solutions, and delivering platforms from PoC and MVP stages to production.
Location: Poland; remote or office work available
Company
delivers engineering and technology solutions, including cloud-based data platforms and analytics systems.
What you will do
- Design, develop, and maintain scalable batch and streaming data pipelines.
- Build and optimize data processing solutions with Python, PySpark, SQL, Apache Spark, and Databricks on AWS.
- Develop and manage workflows using Databricks Workflows and Jobs, Apache Airflow, or MWAA.
- Implement streaming solutions with Apache Kafka, Amazon MSK, or Kinesis.
- Design and maintain Delta Lake-based data architectures.
- Collaborate with technical and business stakeholders throughout the project lifecycle, from PoC and MVP stages through production.
Requirements
- 4+ years of experience in Big Data or Data Engineering.
- Strong proficiency in Python, PySpark, and SQL.
- Hands-on experience with AWS data engineering services and Databricks on AWS.
- Strong knowledge of Apache Spark and large-scale data processing.
- Experience with batch and streaming data processing, Delta Lake, and workflow orchestration tools.
- Upper-intermediate or higher English proficiency required.
Culture & Benefits
- Remote or office work format in Poland.
- Participation in architecture discussions and continuous improvement initiatives.
- Cross-functional collaboration across different stages of project delivery.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
6 дней назад
Data Engineer / Senior Data Engineer (Azure, Databricks, Microsoft Fabric)
7 дней назад
Data Engineer (Databricks)
4 400 - 5 200€
12 дней назад
Data Engineer (Databricks)
15 120 - 21 000PLN
7 дней назад
Senior Analytics Engineer (Snowflake/dbt)
5 700 - 6 600€
8 дней назад
Data Engineer - AWS
5 дней назад
Senior Data Engineer (Azure)
20 000 - 23 000PLN