Senior Data Engineer (Azure, Databricks)

TL;DR

Senior Data Engineer (Azure/Databricks): Building and maintaining scalable financial data pipelines with an accent on data reconciliation, P&L routines, and integration of new data sources. Focus on optimizing data processing using PySpark, Delta Lake, and Azure ecosystem to support AI-driven insights and business-critical financial closing processes.

Location: Must be based in Brazil

Company

hirify.global is a global tech transformation specialist that unites human expertise with AI to create scalable digital solutions for over 1,000 clients.

What you will do

• Develop and maintain robust data pipelines using Databricks, PySpark, Python, and SQL.
• Integrate new data sources into the existing ecosystem to expand platform capabilities.
• Support financial reconciliation, P&L routines, and global closing processes ensuring data consistency.
• Optimize large-scale data processing, storage formats, and query performance using Delta Lake.
• Collaborate with cross-functional teams to deliver high-quality data solutions and support AI-driven initiatives.
• Ensure data governance, auditability, and quality through validation rules and documentation.

Requirements

• Must be based in Brazil
• Strong experience with Databricks (notebooks, jobs, workflows, clusters).
• Proficiency in PySpark, Python, and SQL for data transformation.
• Experience with Delta Lake and Lakehouse architecture.
• Knowledge of Azure data ecosystem (Azure Data Lake Storage).
• Experience supporting financial data pipelines (reconciliation, P&L, financial closing).
• English proficiency required for global team interaction

Nice to have

• Familiarity with AI frameworks and methodologies.
• Experience with Databricks Apps, Streamlit, or advanced Delta Lake optimization.
• Knowledge of data quality observability practices, monitoring, and alerting.

Culture & Benefits

• Global company with over 8,000 employees and 30 years of history.
• Focus on AI-driven innovation and tech transformation.
• Remote work environment.
• Access to career development and learning resources.