3 дня назад
Specialist I - Data Engineer (Brazil Based)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Specialist I - Data Engineer (Brazil Based) (AWS/Spark): Building and evolving a petabyte-scale data platform with highly scalable data pipelines and services, with an accent on distributed systems, cloud-native AWS technologies, and platform reliability. Focus on optimizing data processing and storage, guiding architecture, mentoring engineers, and applying vector databases and AI/LLM techniques.
Location: São Carlos, Brazil; home-based role with availability to travel to São Carlos when needed
Company
is a global data and technology company serving markets including financial services, healthcare, automotive, agribusiness, and insurance, with 25,200 employees across 32 countries.
What you will do
- Design, implement, and evolve a petabyte-scale data platform on AWS.
- Build and optimize scalable, resilient data pipelines using JVM languages, Apache Spark, Python, and cloud-native services.
- Contribute to architecture and design decisions for long-term platform evolution.
- Lead complex technical initiatives and collaborate with product, architecture, engineering, and operations teams.
- Support operational readiness through coding standards, testing, monitoring, release procedures, and production deployments.
- Mentor engineers, lead code reviews, and evaluate technologies such as GraphQL, vector databases, and AI/LLM techniques.
Requirements
- Expert-level software and data engineering experience with large-scale data platforms.
- Deep experience with petabyte-scale systems, Java-based languages such as Scala, and Apache Spark.
- Strong expertise in AWS services including Glue, S3, Athena, Managed Airflow, and Iceberg.
- Advanced understanding of distributed systems, parallel workloads, query optimization, data partitioning, and storage patterns.
- Experience with architecture, technical leadership, mentorship, agile collaboration, Git, GitHub, and Bitbucket.
- Advanced English and availability to travel to São Carlos when needed. A bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience, is required.
Nice to have
- Experience with dbt or modern transformation frameworks.
- Knowledge of concurrent and parallel programming.
- Familiarity with Python, Angular, and TypeScript.
- Experience with vector databases such as pgvector and Redis vector fields.
- Practical experience applying AI/LLM techniques to data platforms, data access, or software quality.
Culture & Benefits
- People-centric, inclusive, and purpose-driven culture.
- Equal opportunity and affirmative action employer.
- Initiatives supporting inclusive recruitment and professional development.
- Affinity groups supporting underrepresented communities, including Pride, Ubuntu, Women in , Aspire, and Connecting Generations.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →