Data Engineer (Azure Databricks)

Location: Remote in Colombia

Company

hirify.global partners with global enterprises in North and South America to deliver digitization, automation, and next-generation digital products and services.

What you will do

• Design, build, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
• Develop and optimize production ETL/ELT processes with Azure Data Factory, Azure Databricks, and Databricks Workflows.
• Implement change data capture solutions for real-time and near-real-time synchronization using Azure SQL CDC, Debezium, or Databricks native CDC through Delta Live Tables.
• Write Python code for data processing and automation, and collaborate with data architects and analysts to translate business requirements into pipeline designs.
• Monitor, troubleshoot, and optimize pipeline performance, reliability, data quality, and cost efficiency across Azure Monitor and Databricks observability tools.
• Support structured and unstructured data integration, analytics and reporting with Power BI, downstream AI/ML use cases, code reviews, documentation, and engineering best practices.

Requirements

• 3+ years of experience in data engineering or a related field.
• Strong hands-on experience with Azure Databricks and proficiency with Apache Spark for large-scale distributed data processing.
• Experience implementing CDC solutions and tools such as Debezium, Azure SQL CDC, or Delta Live Tables.
• Strong Python programming skills for data engineering tasks.
• Solid understanding of SQL and relational database concepts, particularly Azure SQL Database or SQL Managed Instance.
• Experience building and maintaining production ETL/ELT pipelines using Azure Data Factory and/or Databricks Workflows.
• Understanding of data modeling and data warehousing concepts, including dimensional and lakehouse modeling in Azure Synapse Analytics.
• Strong analytical and problem-solving skills.
• Good communication skills and the ability to work across technical and business teams.

Culture & Benefits

• Remote work arrangement in Colombia.
• Collaboration with cross-functional, technical, and business teams.
• Equal opportunity employment.
• Reasonable accommodations are available for candidates with disabilities or medical needs during the recruitment process.