7 часов назад
Senior Big Data Software Engineer (Databricks + AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Big Data Software Engineer (Databricks + AWS): Developing scalable batch and streaming data pipelines and cloud-based data solutions on AWS with an accent on Python, SQL, Databricks, Apache Spark, and Delta Lake. Focus on optimizing large-scale data processing, orchestrating workflows, implementing streaming architectures, and delivering data platforms from PoC and MVP through production.
Location: Poland; Work format: Remote/Office
Company
delivers cloud-based data engineering solutions using AWS, Databricks, and modern big data technologies.
What you will do
- Design, develop, and maintain scalable batch and streaming data pipelines.
- Build and optimize data processing solutions with Python, PySpark, SQL, Apache Spark, and Databricks on AWS.
- Implement and maintain Delta Lake-based data architectures.
- Manage workflows with Apache Airflow or MWAA and support streaming solutions using Apache Kafka, Amazon MSK, or Kinesis.
- Collaborate with technical and business stakeholders and contribute to architecture discussions and continuous improvement.
- Participate in the full project lifecycle from PoC and MVP stages through production implementation.
Requirements
- 4+ years of experience in Big Data or Data Engineering.
- Strong proficiency in Python with PySpark and SQL.
- Hands-on experience with AWS data engineering services and Databricks on AWS.
- Strong knowledge of Apache Spark, large-scale data processing, and batch and streaming data processing.
- Experience with Delta Lake, Databricks Workflows and Jobs, and orchestration tools such as Apache Airflow or MWAA.
- Upper-intermediate or higher English proficiency.
Culture & Benefits
- Work in a remote or office-based format in Poland.
- Collaborate with technical and business stakeholders throughout the project lifecycle.
- Contribute to continuous improvement and data platform modernization initiatives.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
44 минуты назад
Data Engineer (Databricks)
4 400 - 5 200€
17 часов назад
Senior Data Engineer
2 дня назад
Data Engineer (Python/Spark)
3 дня назад
Senior Big Data Engineer (AdTech Cybersecurity)
2 дня назад
Senior Data Engineer (Data Unification)
Andersen Lab
3 часа назад
Senior Data Scientist (Warsaw, Porto, Amsterdam)
3 000 - 4 500€