10 дней назад
Teach Lead Data Engineer (Brazil Based)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Teach Lead Data Engineer (Brazil Based) (AWS/Spark): Building and evolving a petabyte-scale AWS data platform and highly scalable data pipelines with an accent on distributed systems, cloud-native services, and resilient data processing. Focus on leading architecture decisions, mentoring engineers, optimizing storage and queries, and applying vector databases and AI/LLM techniques.
Location: Brazil-based, home-based, with availability to travel to São Carlos/SP when needed
Employment: Permanent, full time
Company
Global data and technology company serving markets including financial services, healthcare, automotive, agribusiness, and insurance.
What you will do
- Design, implement, and evolve a petabyte-scale data platform on AWS.
- Build and optimize resilient, high-performance data pipelines using JVM languages, Spark, Python, and cloud-native services.
- Guide architecture and technical design decisions with architects, product owners, and engineering leaders.
- Lead complex technical initiatives and promote operational readiness through testing, monitoring, coding standards, and release practices.
- Mentor engineers, conduct code reviews, and improve engineering practices across agile teams.
- Explore GraphQL, vector databases, and AI/LLM techniques for data access and platform efficiency.
Requirements
- Expert-level software and data engineering experience with large-scale data platforms.
- Deep experience with Java-based languages such as Scala, Apache Spark, and petabyte-scale systems.
- Strong expertise in AWS data services, including Glue, S3, Athena, Managed Airflow, and Iceberg.
- Advanced knowledge of distributed systems, parallel workloads, query optimization, data partitioning, and storage patterns.
- Experience with architecture, technical leadership, mentoring, Git-based collaboration, and agile engineering environments.
- Advanced English and availability to travel to São Carlos/SP when needed.
Nice to have
- Experience with DBT or modern transformation frameworks.
- Knowledge of concurrent and parallel programming.
- Familiarity with Python, Angular, and TypeScript.
- Experience with vector databases and practical AI/LLM applications.
Culture & Benefits
- People-centric, inclusive, and purpose-driven culture.
- Global organization with 25,200 employees across 32 countries.
- Focus on diversity, inclusive recruitment, and professional development.
- Affinity groups supporting LGBTQIAPN+ people, racial equity, gender equity, people with disabilities, and multiple generations.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →