Senior Big Data Engineer (AWS + Databricks)

TL;DR

Senior Big Data Engineer (AWS + Databricks): Building end-to-end data & analytics solutions from technical design to full-scale implementation with an accent on data pipeline creation and AWS cloud platform. Focus on developing scalable batch and streaming processing systems using PySpark and Databricks.

Location: Remote or Office in Poland

Company

A global digital solutions company specializing in data consulting and engineering for healthcare, finance, manufacturing, retail, and energy domains.

What you will do

• Develop and implement data solutions on the AWS cloud platform.
• Build and manage large-scale data pipelines using Databricks and Apache Spark.
• Implement both batch and streaming data processing workflows.
• Utilize Delta Lake and core Databricks components (Workflows, Jobs).
• Set up orchestration using Apache Airflow or Managed Apache Airflow (MWAA).
• Integrate data streaming technologies such as Apache Kafka, Amazon MSK, or Kinesis.

Requirements

• 4+ years of professional experience in the Big Data field.
• Proficiency in Python (PySpark) and SQL.
• Hands-on experience with Databricks on AWS and Delta Lake.
• Experience with large-scale data processing using Apache Spark.
• Knowledge of orchestration tools (Airflow) and streaming platforms (Kafka/Kinesis).
• Must be based in Poland.

Culture & Benefits

• Flexible workplace: work from home or from any office within Poland.
• Dedicated career development plans for all roles.
• Full access to Udemy learning courses for upskilling.
• Company-funded and encouraged professional certifications.
• Opportunity to work with cutting-edge, early-access cloud technologies.