Senior Big Data Engineer (AWS + Databricks)

TL;DR

Senior Big Data Engineer (AWS + Databricks): Designing and implementing large-scale data pipelines and end-to-end analytics solutions with an accent on batch and streaming processing. Focus on building scalable data architectures using PySpark, Databricks, and AWS cloud services to solve complex business challenges.

Location: Poland (Remote/Office)

Company

hirify.global is a global digital solutions company providing high-end data consulting and engineering services across various domains including healthcare, finance, and retail.

What you will do

• Develop and manage end-to-end data pipelines on the AWS cloud platform using Databricks.
• Implement and optimize both batch and streaming data processing solutions.
• Engage in the full project lifecycle, from initial design and Proof of Concepts (PoCs) to MVP and full-scale implementation.
• Collaborate with global clients ranging from large corporations to emerging crypto startups.
• Investigate new technologies, build internal prototypes, and contribute to the hirify.global data community.

Requirements

• 4+ years of professional experience in the Big Data field.
• Proficiency in Python (PySpark) and SQL.
• Hands-on experience building data solutions on AWS with Databricks, Apache Spark, and Delta Lake.
• Experience with orchestration tools such as Apache Airflow or Managed Apache Airflow (MWAA).
• Knowledge of data streaming technologies like Apache Kafka, Amazon MSK, or Kinesis.
• Must be based in Poland (as indicated by location and work format).

Culture & Benefits

• Dedicated career development plans tailored for every role.
• Full access to Udemy learning courses for continuous upskilling.
• Company-covered professional certifications.
• Opportunity to work with cutting-edge, early-access cloud technologies.
• Collaborative environment focused on daily knowledge-sharing and mentorship from top-notch architects.