Lead Distributed Data Platform Engineer (Spark)

TL;DR

Lead Distributed Data Platform Engineer (Spark): Building and optimizing an internal data ecosystem and analytics platform with an accent on lakehouse technologies and distributed compute frameworks. Focus on designing scalable data pipelines, managing Delta Lake/Iceberg architectures, and driving technical leadership across the data platform team.

Location: Remote (Poland)

Salary: 270,000 - 406,000 PLN

Company

hirify.global provides a specialized software platform for eDiscovery and data management.

What you will do

• Lead and mentor a team of data platform engineers, promoting professional growth and collaboration.
• Drive architectural decisions for distributed systems and lakehouse platforms using Spark, Delta Lake, and Iceberg.
• Oversee the design and implementation of scalable data pipelines and analytics workflows.
• Ensure software engineering excellence through clean code, CI/CD, automated testing, and code reviews.
• Collaborate with stakeholders to align technical solutions with business objectives and analytics needs.
• Manage performance tuning, scalability strategies, and cost optimization in cloud-native environments.

Requirements

• Proven experience leading technical teams in data engineering or platform development.
• Strong programming skills in Python and SQL with hands-on experience in Apache Spark.
• Expertise in lakehouse architecture using Delta Lake and/or Apache Iceberg.
• Familiarity with dbt, Databricks, and Snowflake for analytics workflows.
• Solid understanding of CI/CD, automated testing, Kubernetes, and Docker.
• Must be based in Poland

Nice to have

• Exposure to event-driven architectures and advanced analytics platforms.
• Experience enabling self-service analytics for internal stakeholders.
• Proficiency in Java, Scala, or Rust.
• Exposure to service mesh and advanced orchestration patterns.

Culture & Benefits

• Comprehensive health, dental, and vision plans.
• Parental leave for primary and secondary caregivers.
• Flexible work arrangements and additional time off.
• Two week-long company breaks per year.
• Long-term incentive and training investment programs.