24 часа назад
Data Engineer (Spark)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Spark/Python): Building and maintaining data pipelines that process large datasets, perform complex transformations, and integrate analytical models with an accent on Spark optimization, Azure infrastructure, and Databricks. Focus on designing efficient ETL workflows, optimizing performance and memory utilization, and supporting reliable handoffs to L2 teams.
Location: Remote, Ciudad de México, Mexico
Salary: Up to MXN 0 per month
Company
is a consumer intelligence company providing retail and consumer buying insights across more than 90 countries.
What you will do
- Maintain and assemble data pipelines that process large datasets and perform complex transformations.
- Integrate completed analytical models into data pipelines used to generate customer insights.
- Optimize Spark code, including code supporting data science models.
- Build infrastructure for extracting, transforming, and loading data from multiple sources using Azure, Databricks, and SQL.
- Document implemented features and transition them to L2 support.
Requirements
- 5–8 years of experience as a data engineer.
- Hands-on experience modeling or manipulating large datasets and building data pipelines.
- Strong proficiency with Apache Spark using Python and/or Scala.
- Programming experience with Python, Scala, and SQL.
- Direct experience with Apache Spark, Databricks or Fabric, and Airflow.
- Ability to write efficient code focused on performance and memory utilization, with strong collaboration and prioritization skills.
Nice to have
- Knowledge of data warehousing concepts, strategies, and methodologies.
- Experience with CI/CD and DevSecOps.
- Retail business experience.
- Cloud certification for data engineering.
- Basic exposure to AI tools.
Culture & Benefits
- Flexible working environment.
- Volunteer time off.
- LinkedIn Learning access.
- Employee Assistance Program.
- Inclusive workplace focused on diversity, equity, and inclusion.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →