Senior Data Engineer (Azure Databricks)

Location: Remote, San José Province, Costa Rica

Company

hirify.global designs, builds, and scales AI-powered solutions across design, development, cloud, data, and artificial intelligence.

What you will do

• Design, build, and maintain reliable production-grade data pipelines using Azure Databricks and Python.
• Develop scalable PySpark and Spark SQL transformations integrating data from APIs, relational databases, cloud storage, SFTP, and enterprise platforms.
• Integrate ticketing, CRM, marketing, retail, and other business systems into a centralized Data Hub.
• Develop data warehouses, dimensional models, data marts, and outbound feeds for third-party systems.
• Implement data quality validations, consistency checks, and optimized SQL transformations.
• Investigate discrepancies, troubleshoot pipeline failures, document technical processes, and communicate risks and progress.

Requirements

• 5+ years of professional Data Engineering experience designing, building, and maintaining production-grade data pipelines.
• Strong hands-on experience with Azure Databricks, advanced Python, and Apache Spark, including PySpark and/or Spark SQL.
• Advanced SQL skills, including complex transformations, data validation, and query performance optimization.
• Solid knowledge of data warehousing and dimensional modeling, including facts, dimensions, and data marts.
• Experience integrating data from REST APIs, relational databases, cloud storage, SFTP, and multiple enterprise systems.
• Hands-on experience with Microsoft Azure data services for ingestion, storage, processing, and integration.
• Experience implementing data quality checks and validating consistency between source systems and target data models.
• Strong problem-solving, analytical, organizational, ownership, autonomy, documentation, and engineering-practice skills.
• Strong English communication skills and the ability to collaborate with a US-based enterprise team.

Nice to have

• Experience migrating SQL-based data workloads to Azure Databricks.

Culture & Benefits

• Remote work arrangement in Costa Rica.
• Culture centered on Empowering Excellence, Collaborative Teamwork, Unsolicited Respect, Consistent Transparency, and Efficient Communication.
• Opportunity to work on AI-native transformation and scalable business solutions.
• Emphasis on learning quickly, ownership, technical discipline, clear documentation, and proactive communication.