Senior Data Engineer Databricks

TL;DR

Senior Data Engineer Databricks (Data Engineering): Responsible for designing, developing, and maintaining high-quality data pipelines and lakehouse architectures in Databricks with an accent on data governance, security, and PII protection. Focus on implementing and optimizing medallion architecture, ensuring data quality, and supporting migration from legacy systems to AWS-based Databricks environments.

Location: Colombia, Hybrid

Company

hirify.global is a global company that offers Software and Digital Engineering solutions.

What you will do

• Design, build, and optimize scalable data pipelines and lakehouse architectures in Databricks using the medallion model (bronze, silver, gold).
• Develop and maintain ETL/ELT processes in Python and PySpark, ensuring high data quality, performance, and reliability.
• Implement and enforce data governance, security, encryption, and PII protection standards across the platform.
• Collaborate with engineering and business teams to translate requirements into dimensional models and support migration from legacy systems to AWS-based Databricks environments.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field; advanced certifications in Data Engineering or Cloud are highly valued.
• 5+ years of progressive experience in Data Engineering building scalable, production-grade data platforms.
• 3+ years of deep hands-on experience with Databricks and modern Lakehouse architecture in enterprise environments.
• Expert-level proficiency in Python and PySpark, designing high-performance distributed data processing pipelines.
• Strong expertise designing and implementing dimensional data models (Star Schema, SCDs, fact/dimension load strategies) for analytical workloads.
• Databricks certification strongly preferred and considered close to mandatory for senior-level candidacy

Nice to have

• Experience leveraging AI-assisted development tools or agentic coding platforms to enhance productivity and data engineering workflows is a strong plus

Culture & Benefits

• Hiring professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.