Senior Big Data Engineer (Databricks + Azure)

TL;DR

Senior Big Data Engineer (Databricks/Azure): Designing and implementing scalable batch and streaming ETL pipelines on the Databricks Lakehouse platform with an accent on data governance, performance tuning, and Lakehouse architecture. Focus on building bronze-silver-gold data layers, optimizing PySpark jobs, and integrating AI/BI capabilities for reliable data delivery.

Location: Must be based in Poland (Remote/Office)

Company

hirify.global is a global IT services and consulting company providing high-end engineering and technology solutions.

What you will do

• Design, develop, and maintain scalable batch and streaming ETL pipelines on the Databricks Lakehouse platform.
• Build and optimize data processing solutions using PySpark, Python, and SQL.
• Implement data governance and access control practices using Unity Catalog.
• Design and maintain bronze–silver–gold Lakehouse architectures using Delta Lake.
• Develop and deploy data solutions using Databricks Asset Bundles and CI/CD processes.
• Expose and visualize data using Databricks SQL and BI tools such as Power BI.

Requirements

• 5+ years of experience in Data Engineering, including designing data models and scalable ETL pipelines.
• Strong expertise in PySpark, Python, and SQL, including performance tuning and optimization.
• Hands-on experience with Databricks clusters, SQL Warehouses, and Unity Catalog.
• Strong understanding of Delta Lake and Lakehouse architecture concepts.
• Experience delivering end-to-end data solutions using Databricks Asset Bundles and CI/CD practices.
• English: Upper-intermediate (B2) or higher required.

Nice to have

• Familiarity with Databricks AI/BI tools such as MLflow, Dashboards, Metric Views, Genie, or agents.
• Experience with Azure data services: ADF, Synapse, ADLS, Azure DevOps, or Microsoft Fabric.

Culture & Benefits

• Flexible work arrangement (Remote/Office).
• Equal opportunity employer environment.
• Opportunity to work with cutting-edge Databricks AI/BI capabilities.