Senior Data Engineer

TL;DR

Senior Data Engineer (Azure): Designing and building scalable data pipelines to ingest, process, and transform high volume drilling data using Azure Data Factory and Azure Synapse Analytics. Focus on implementing complex logic to convert time based drilling sensor data into depth based datasets for geological and operational alignment, ensuring data quality and consistency.

Location: Hybrid (Peru)

Company

hirify.global is a global company that offers Software and Digital Engineering solutions.

What you will do

• Design and build scalable data pipelines using Azure Data Factory and Azure Synapse.
• Implement complex logic to convert time-based drilling sensor data into depth-based datasets.
• Develop ingestion frameworks to process diverse drilling data formats from multiple vendors.
• Ensure data quality, availability, and consistency by implementing automated validation checks.

Requirements

• Strong experience designing and implementing data pipelines using Azure Data Factory and Azure Synapse Analytics.
• Advanced proficiency in SQL and experience working with large scale data processing.
• Strong programming skills in Python with experience using PySpark or Pandas for data processing.
• Experience managing and organizing data in Azure Data Lake Storage Gen2.
• Understanding of ETL and ELT patterns and modern data engineering best practices.

Nice to have

• Microsoft Certified Azure Data Engineer Associate (DP 203) certification is a plus.

Culture & Benefits

• hirify.global hires professionals based solely on their skills and does not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.