3 дня назад
Principal Data Engineering
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Data Engineering (Data Mesh/AWS/Databricks): Architecting and building scalable, fault-tolerant data systems, pipelines, and enterprise data mesh solutions with an accent on data integration, governance, modeling, and cloud architecture. Focus on designing distributed workloads, improving data quality and performance, and mentoring teams across data engineering and digital platforms.
Location: Sumaré, São Paulo, Brazil; onsite at least four days per week
Company
is an innovation-focused global company developing technologies and products for markets including energy, manufacturing, personal safety, transportation, electronics, and consumer applications.
What you will do
- Architect, design, and build scalable, efficient, and fault-tolerant data operations and systems.
- Develop and maintain data pipelines for ingesting, transforming, and distributing structured and unstructured data.
- Drive data integration, modeling, governance, and enterprise data mesh initiatives.
- Collaborate with senior leaders, analysts, engineers, scientists, informaticians, and domain teams on digital solutions.
- Review code, improve performance and maintainability, and enforce testing and engineering standards.
- Provide technical guidance, mentorship, project planning, recruitment support, and training across teams.
Requirements
- Bachelor’s degree or higher in Computer Science, or equivalent education and experience.
- Professional experience in data management, data governance, and data warehouse or lakehouse design and development.
- Proficiency with SQL and NoSQL data management systems.
- Experience architecting modern distributed cloud workloads using AWS and Databricks.
- Extensive hands-on experience with Python, Apache Spark, PySpark, API data extraction, and data pipeline development.
- Advanced English proficiency and the ability to work onsite at Sumaré at least four days per week.
Nice to have
- Experience with data mesh architecture, Delta Lake, MLflow, Unity Catalog, AWS S3, AWS Glue, and Amazon EMR.
- Experience with stream processing systems such as Amazon Kinesis, Kafka, Spark, or Storm.
- Knowledge of Docker, Kubernetes, APIs, Temporal.io, Apache Airflow, data visualization tools, and relational or NoSQL databases.
- Experience with feature engineering, data quality, validation, encryption, access control, and authentication.
- Agile development experience with tools such as JIRA and Confluence, plus strong collaboration and communication skills.
Culture & Benefits
- Work in an agile, collaborative environment with global colleagues and matrixed teams.
- Access competitive compensation and benefits supported by regular market benchmarking.
- Contribute to ’s Environmental Health and Safety culture by following safety policies and identifying hazards.
- Participate in programs supporting physical and financial well-being.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →