2 дня назад
Senior Data Engineer (AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AWS): Developing and maintaining data pipelines and integrating data from APIs, relational databases, and files with an accent on reliability, security, governance, and modern DataOps practices. Focus on building AWS-based processing solutions with Python, SQL, Spark, Glue, Lambda, Iceberg, and Athena, while ensuring data quality and compatibility across services.
Location: Campinas, São Paulo, Brazil — on-site, 5 days per week at the Campinas office
Company
CI&T delivers AI deployment, application modernization, data and AI, martech, and business strategy solutions for large enterprises.
What you will do
- Develop and maintain data pipelines using AWS data services.
- Integrate data from APIs, relational databases, files, and other sources.
- Collaborate with business and analytics teams to define data requirements.
- Ensure the quality, reliability, security, and governance of ingested data.
- Apply DataOps practices including code versioning, data tests, and CI/CD.
- Document data engineering processes and best practices.
Requirements
- Availability to work on-site at the Campinas office 5 days per week.
- Experience building data pipelines in AWS with S3, Glue, Lambda, Iceberg tables, Spark, and Athena.
- Strong Python and SQL skills for data processing and transformation.
- Understanding of ETL/ELT frameworks, data warehousing, and distributed data processing.
- Experience with modern DataOps practices and familiarity with AWS, Azure, or GCP data services.
- Advanced English level.
Nice to have
- Experience with Databricks, Lakehouse, and Unity Catalog.
- Experience with data contracts, schema evolution, and service compatibility.
- Knowledge of data quality frameworks such as Great Expectations, Soda, dbt tests, or custom solutions.
- Familiarity with dbt, Atlan, Soda, Power BI, and data streaming.
Culture & Benefits
- Health and dental insurance, life insurance, and meal and food allowance.
- Childcare assistance and extended paternity leave.
- Profit sharing and results participation.
- Continuous learning through CI&T University, online learning platforms, and a language learning platform.
- Wellness partnerships, a physical and mental well-being platform, and a discount club.
- Inclusive selection process with accessibility support and dedicated health, well-being, and inclusion specialists.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →