7 дней назад
Lead Data Engineer (Brazil Based)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (AWS/Spark): Building and evolving a petabyte-scale data platform and highly scalable data pipelines with an accent on distributed systems, cloud-native engineering, and platform reliability. Focus on optimizing parallel data processing, guiding architecture and technical initiatives, and applying vector databases and AI/LLM techniques.
Location: Brazil-based, São Carlos; home-based with availability to travel to São Carlos/SP when needed
Company
is a global data and technology company that develops solutions for people and businesses across financial services, healthcare, automotive, agribusiness, insurance, and other markets.
What you will do
- Design, implement, and evolve a petabyte-scale data platform on AWS.
- Build and optimize resilient, production-ready data pipelines using JVM languages, Apache Spark, Python, and cloud-native services.
- Lead technical initiatives, mentor engineers, conduct code reviews, and promote engineering best practices.
- Contribute to architecture and design decisions with architects, product owners, and engineering leadership.
- Plan and deliver complex technical initiatives within agile value-stream teams.
- Ensure operational readiness through testing, monitoring, coding standards, release procedures, and production support.
Requirements
- Expert-level software and data engineering experience with large-scale data platforms.
- Deep experience with petabyte-scale systems, Java-based languages such as Scala, and Apache Spark.
- Strong expertise in AWS data services, including Glue, S3, Athena, Managed Airflow, and Iceberg.
- Advanced knowledge of distributed systems, parallel workloads, query optimization, data partitioning, and efficient storage patterns.
- Experience influencing architecture, mentoring engineers, reviewing code, collaborating across engineering teams, and using Git-based version control.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience. Advanced English and availability to travel to São Carlos/SP when needed are required.
Nice to have
- Experience with DBT or modern transformation frameworks.
- Knowledge of concurrent and parallel programming.
- Familiarity with Python, Angular, and TypeScript.
- Experience with vector databases such as pgvector or Redis vector fields.
- Practical experience applying AI/LLM techniques to data platforms, data access, or software quality.
Culture & Benefits
- People-centric, inclusive, and purpose-driven culture.
- Global organization with 25,200 employees across 32 countries.
- Focus on diversity, inclusive recruitment, and professional development.
- Affinity groups supporting LGBTQIAPN+ people, racial equity, gender equity, people with disabilities, and intergenerational collaboration.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →