Назад
Company hidden
3 дня назад

Sr. Data Engineer - Integrations (Spark)

Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Mexico
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Sr. Data Engineer - Integrations (Spark): Designing enterprise-scale data integration pipelines, scalable data products, and JVM-based REST microservices with an accent on Spark optimization, Medallion architectures, and Azure Data Services. Focus on resolving distributed computing bottlenecks, architecting highly available backend systems, and automating delivery through CI/CD pipelines.

Location: Mexico City, Mexico. Travel required: 00%–25%. Relocation is not provided.

Company

The hirify.global Company is a global beverage company focused on refreshing the world and making a difference through an inclusive, growth-oriented culture.

What you will do

  • Architect and oversee enterprise-scale data integration pipelines and data products using Medallion architecture patterns in Microsoft Fabric.
  • Optimize Spark workloads through Catalyst query-plan analysis, JVM memory profiling, data partitioning, storage formats, and platform configuration.
  • Lead the design of highly available REST-based microservices and APIs on the JVM for low-latency interoperability across internal and external systems.
  • Develop modular, testable, maintainable code using functional programming principles, SOLID principles, and industry best practices.
  • Define engineering standards, conduct architectural reviews, lead code-quality initiatives, and mentor Grade 10 and junior engineers.
  • Architect and maintain CI/CD pipelines with GitHub Actions, Maven, and SBT for testing, deployment, and data-artifact configuration.

Requirements

  • Expert-level Scala proficiency and JVM architecture experience, including JVM internals and concurrent, modular system design using advanced functional programming concepts.
  • At least 5 years of hands-on Apache Spark experience building, debugging, and optimizing enterprise-grade distributed computing applications, preferably with Scala, including data-skew and memory-management issues at scale.
  • Extensive experience designing scalable STAR, Vault, and Tabular data models, Medallion architectures, complex enterprise analytics, and structured streaming applications.
  • Proven experience architecting and scaling REST-based microservices and robust JVM backend applications.
  • 4–5+ years of combined architectural experience with Azure Data Services, including Synapse, Microsoft Fabric, Azure Data Factory, and Azure Functions.
  • Proven ability to architect automated release cycles and infrastructure deployment, with hands-on expertise in Git, GitHub Actions, Maven, SBT, and environment configuration for parallel development.
  • Experience with Agile development, including Scrum and lean techniques, and collaboration with global engineering teams.

Culture & Benefits

  • Inclusive culture grounded in the company purpose and four behaviors: curious, empowered, inclusive, and agile.
  • Growth mindset and continuous learning are emphasized.
  • Full-time employment in Mexico City.
  • Travel requirement of 00%–25%.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →