Data Engineer (Azure, Spark)

TL;DR

Data Engineer (Azure, Spark): Designing and maintaining data ingestion and transformation pipelines, integrating diverse data sources, and ensuring data quality. Focus on optimizing performance for high-volume data extraction processes and collaborating on event-driven architectures.

Location: Remote from Mexico

Company

hirify.global is a global leader in consulting, technology services, and digital transformation, with over 340,000 professionals and a significant presence in Mexico.

What you will do

• Design and maintain data ingestion and transformation pipelines.
• Integrate multiple data sources in various formats.
• Ensure data quality, integrity, and reliability.
• Optimize performance for high-volume data extraction processes.
• Collaborate with technical teams using event-driven architectures.

Requirements

• Designing and implementing ETL processes and data pipelines.
• Working with SQL and NoSQL databases, including query optimization.
• Hands-on experience with Azure services (ADF, Databricks, Azure SQL, Event Hubs).
• Programming experience in Python and/or .NET C# or Java.
• Experience with Big Data technologies such as Spark and Kafka.
• English: B2 required

Culture & Benefits

• Work in a collaborative team environment, focusing on technology solutions for clients.
• Contribute to client satisfaction by providing timely and responsive services.
• Receive a competitive compensation and benefits package.
• Work in a deeply multicultural organization with a focus on professional development.
• Benefit from a supportive environment that values honesty, boldness, and team spirit.
• Access programs designed to help build your career and professional skills foundation.