Tech Lead (Data Engineering)

TL;DR

Tech Lead (Data Engineering) (Spark/Scala): Leading the design and delivery of scalable data-driven solutions and pipelines with an accent on Spark and Scala. Focus on architecting scalable data systems, optimizing workflows for data ingestion and storage, and mentoring engineering teams.

Location: Hybrid position based in Warsaw, Poland

Company

International consulting group specializing in innovation and business transformation through technology.

What you will do

• Lead end-to-end technical delivery of data engineering projects
• Architect and implement scalable data pipelines and platforms using Spark, Airflow, and Hive
• Optimize workflows for data ingestion, processing, and storage
• Oversee code quality, CI/CD pipelines, and release management
• Mentor engineers to foster technical excellence and growth
• Develop and maintain data lake solutions for structured and unstructured data

Requirements

• 7+ years of experience in Big Data systems and data management
• 3+ years of hands-on experience with Scala and Spark
• Hands-on experience with Cloudera, Airflow, and Hive
• Excellent understanding of dimensional data and data modeling techniques
• Experience implementing and deploying solutions in cloud environments
• English: C1 level required

Nice to have

• Experience with Databricks, Kafka, Docker, Kubernetes, or OpenShift
• Knowledge of GitHub Actions, Control-M, and Bash scripting
• Familiarity with cybersecurity practices (Sonar, Fortify) and SDLC
• Experience with microservices, REST APIs, and Node.js, React, or NextJS

Culture & Benefits

• Permanent full-time contract with career development opportunities
• Multicultural environment with international projects
• Exposure to large-scale financial IT systems and cross-country operations
• Training opportunities to develop new skills in finance, technology, and data management