Senior Data Engineer (Databricks + PySpark + ADF + Unity Catalog)

Location: Remote from Bogotá, Medellín, Costa Rica, Buenos Aires, Lima, or São Paulo

Salary: $5,208–$6,048 USD per month

Company

Supports a large-scale enterprise data modernization initiative focused on cloud-based analytics and scalable data platforms.

What you will do

• Design, develop, and optimize ETL/ELT pipelines using Azure Data Factory and Databricks.
• Build scalable data ingestion frameworks for structured and unstructured data sources.
• Develop data transformations with PySpark, Spark SQL, and Databricks notebooks.
• Implement Unity Catalog governance, security, and access controls.
• Create and optimize Delta Lake architectures for analytics and reporting workloads.
• Monitor pipeline performance, troubleshoot production issues, and collaborate with architects and analytics stakeholders.

Requirements

• 4–7+ years of experience in data engineering or big data development.
• Hands-on experience with Azure Databricks, PySpark, Spark SQL, Unity Catalog, and Azure Data Factory.
• Experience with Delta Lake, Lakehouse architectures, data modeling, ETL/ELT, and data warehousing.
• Knowledge of Azure cloud services, Git, version control, CI/CD, and DevOps practices.
• Strong analytical, problem-solving, communication, and stakeholder management skills.
• Remote work is limited to Bogotá, Medellín, Costa Rica, Buenos Aires, Lima, or São Paulo.

Nice to have

• Experience with Azure Synapse Analytics, Collibra, or other data governance platforms.
• Infrastructure as Code experience with Terraform or ARM Templates.
• Databricks or Microsoft Azure Data Engineer certification.
• Experience with enterprise-scale data migrations, healthcare, retail, consumer products, or real-time streaming data.

Culture & Benefits

• Remote contract role supporting an enterprise data modernization initiative.
• Collaboration with data architects, business stakeholders, analytics teams, and cross-functional engineering teams.
• Work focused on reliable, high-performance, secure, and compliant data platforms.