Data Engineer (Brazil)

TL;DR

Data Engineer (Brazil): Designing, developing, and maintaining an open-source data platform with an accent on Data-Lakehouse architecture, ETL processes, and workflow orchestration. Focus on optimizing data pipelines, ensuring system scalability, and collaborating with cross-functional teams to deliver robust data infrastructure.

Location: Must be based in Brazil

Company

hirify.global is a technology company focused on building advanced data platforms and infrastructure.

What you will do

• Develop a scalable data platform integrating multiple sources for easy access.
• Design and enhance data tools including orchestration, governance, and BI integration.
• Optimize data pipelines for ingestion, processing, and output within a microservices environment.
• Build, maintain, and monitor ETL/ELT processes using Temporal.
• Troubleshoot and improve the performance and reliability of the data infrastructure (S3, Apache Iceberg, ClickHouse).
• Implement data quality, governance, and security best practices across the platform.

Requirements

• Must be based in Brazil
• 3+ years of experience as a Data Engineer or in a similar data infrastructure role.
• Strong proficiency in SQL and hands-on experience with data modeling.
• Experience with data lake/lakehouse architectures and analytical columnar databases.
• Strong programming skills in Python and/or Scala/Java.
• Experience working within a microservices architecture and cloud environments (AWS preferred).
• Professional proficiency in written and spoken English

Nice to have

• Experience contributing to open-source data platforms.
• Familiarity with BI and visualization tools like Superset or Looker.
• Experience with containerization (Docker, Kubernetes) and CI/CD practices.
• Experience with AWS EMR and Apache Spark workloads.
• Experience leveraging AI-assisted development tools.