Senior Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (Databricks): Building and optimizing scalable data ingestion pipelines for a global enterprise data foundation with an accent on Medallion Architecture and PySpark. Focus on standardizing data workflows, ensuring high data quality, and collaborating with international stakeholders to align local implementations with global platform standards.
Location: Must be based in Brazil
Company
is a global tech transformation specialist that unites human expertise with AI to create scalable digital solutions for over 1,000 clients.
What you will do
- Design, develop, and maintain scalable PySpark and SQL ingestion pipelines.
- Build and optimize ETL/ELT workflows aligned with Medallion Architecture standards.
- Integrate data from multiple sources into enterprise data lake environments.
- Ensure data quality, integrity, reliability, and performance across all ingestion processes.
- Align local ingestion workflows with global platform standards and governance.
- Monitor, troubleshoot, and improve ingestion pipelines and data workflows.
Requirements
- English: C1 or higher required (daily interaction with US stakeholders).
- Must be based in Brazil.
- Proven experience as a Data Engineer focused on ingestion and transformation.
- Hands-on experience with Databricks and Medallion Architecture.
- Strong proficiency in PySpark and SQL.
- Experience working with Data Lakes and modern data platform concepts.
Nice to have
- Databricks or cloud certifications.
- Experience with Power BI.
- Knowledge of modern data integration and governance practices.
- Experience with Azure.
Culture & Benefits
- Health and dental insurance.
- Profit Sharing and Results Participation (PLR).
- Continuous learning via University and online platform partnerships.
- Well-being support including gym partnerships and mental health resources.
- Extended paternity leave and childcare assistance.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →