Data Engineer (Azure, Databricks)

TL;DR

Data Engineer (Azure/Databricks): Designing, developing, and optimizing large-scale data pipelines on the Azure platform with an accent on ingestion, transformation, and delivery. Focus on building complex workflows using Databricks, ensuring data quality via Delta Lake, and implementing robust DataOps practices.

Location: Must be based in or able to work from Montréal (Hybrid)

Company

hirify.global is an international consulting and engineering group and a world leader in the design of transport infrastructures.

What you will do

• Design and develop batch and real-time data ingestion pipelines from diverse sources.
• Orchestrate complex data flows using Azure Data Factory or Azure Synapse.
• Develop advanced data processing workflows using Apache Spark, PySpark, or Scala.
• Ensure data quality, traceability, and governance through Delta Lake.
• Optimize pipeline performance and Spark processing jobs.
• Collaborate with Data Science, BI, and Architecture teams to maintain platform scalability.

Requirements

• Minimum 5 years of experience as a Data Engineer.
• Hands-on experience with large-scale data projects in an Azure & Databricks environment.
• Strong command of Azure Data Lake Storage Gen2, Data Factory, and Synapse.
• Proficiency in data modeling and handling structured/semi-structured data formats (Avro, Parquet, JSON).
• Experience with Git, CI/CD pipelines, and automated testing.
• Strong analytical mindset and technical communication skills.

Nice to have

• Proficiency in Scala and advanced SQL.
• Knowledge of event-driven architectures like Kafka or Event Hub.
• Understanding of MLOps and collaboration with Data Scientists.
• Microsoft DP-203 or Databricks certifications.

Culture & Benefits

• Work within a global leader in transport infrastructure engineering.
• Commitment to a diverse and inclusive workplace.
• Opportunity to work on large-scale, impactful data projects.
• Collaborative and agile work environment.