Senior Data Engineer (Azure Databricks)

TL;DR

Senior Data Engineer (Azure Databricks): Designing and building scalable data pipelines and lakehouse solutions with an accent on Azure Databricks, Delta Lake, and PySpark. Focus on architecting high-performance data workflows, implementing robust data governance, and collaborating with cross-functional teams to drive cloud-first data strategies.

Company

hirify.global is an execution partner helping organizations drive digital transformation, modernization, and scalable technology solutions.

What you will do

• Design and maintain robust ETL/ELT pipelines using Azure Databricks and Azure Data Factory.
• Architect scalable data lakehouse solutions on Azure using Delta Lake.
• Optimize Spark-based data transformations and manage Databricks cluster performance.
• Implement data quality frameworks, lineage tracking, and governance practices.
• Mentor junior engineers and conduct code reviews to ensure high-quality deliverables.
• Collaborate with data scientists and DevOps teams to productionize ML models and infrastructure.

Requirements

• 7+ years of hands-on experience with Azure Databricks, Spark SQL, and Delta Lake.
• Strong proficiency in Python and SQL.
• Deep understanding of distributed computing principles and the Apache Spark ecosystem.
• Experience with Azure data services including ADLS Gen2, Azure Synapse, and Event Hubs.
• Solid understanding of data warehousing concepts and dimensional modeling.
• Experience with version control, CI/CD tools, and infrastructure-as-code practices.

Nice to have

• Databricks Certified Data Engineer Associate or Professional certification.
• Microsoft Certified: Azure Data Engineer Associate (DP-203).
• Experience with Delta Live Tables and Databricks Workflows.
• Familiarity with Power BI or other BI reporting tools.
• Experience with Scala or Java for Spark development.

Culture & Benefits

• Opportunity to work on high-impact digital transformation projects for top-tier companies.
• Collaborative environment focused on growth, mentorship, and technical excellence.
• Exposure to cutting-edge cloud data technologies and modern engineering practices.