TL;DR

Senior Big Data Engineer: Building and maintaining scalable Big Data solutions for data architecture and ecosystem management with an accent on Cloudera, Spark, and modern data lakehouse architectures. Focus on designing Big Data architectures, optimizing performance, and ensuring high data quality across diverse business areas.

Location: Must be based in LATAM

Company

%hirify_global% is a global technology services provider, part of Avenga, with over 6000 specialists offering a full spectrum of services including business and tech advisory, enterprise solutions, and software development.

What you will do

Maintain and optimize the Big Data ecosystem using Cloudera platform, including configuration and functional testing.
Handle, process, and manage unstructured data from multiple sources.
Design and build scalable Big Data architectures applicable to various business domains.
Implement data models for storing both structured and unstructured information.
Create efficient data flows for seamless information processing, including loading, validation, and transformation.
Build and optimize data pipelines and streaming solutions using Flume, Sqoop, and Kafka, and create dashboards with Kibana, Tableau, or Grafana.

Requirements

At least 3 years implementing Big Data solutions for data management using HBase, Hive, and Spark.
2+ years of hands-on SQL experience and handling unstructured data.
2+ years maintaining Big Data ecosystems, specifically Cloudera platform.
3+ years of programming expertise in Python, R, Java, or Scala.
3+ years designing pipeline and streaming solutions with Flume, Sqoop, and Kafka, and implementing dashboards.
Practical experience constructing Data Lakehouse solutions.

Nice to have

Knowledge of Artificial Intelligence solutions, models, and tools.
Experience with AI model implementation and integration.
Advanced metadata analysis capabilities for feature selection.
Multi-cloud Big Data experience.

Culture & Benefits

Build technologies that matter.
Commitment to equal opportunities in recruitment, career development, and leadership.
Fostering a work environment where a diverse community feels free to be themselves.

Hiring process

Application submission and review.
Talent Acquisition Interview.
Technical Interview.
Customer Interview (for some roles).
Job Offer and welcome to the team.