обновлено 7 дней назад
Mid Data & Software Engineer (Scala/Spark)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Mid Data & Software Engineer (Scala/Spark): Building and operating highly scalable, cloud-native data pipelines and platforms for petabyte-scale workloads with an accent on distributed processing, resiliency, and performance. Focus on optimizing parallel data workloads, improving cost efficiency and reliability, and supporting production releases and monitoring.
Location: Home-based in Brazil, with availability to travel to São Carlos, São Paulo, when needed.
Company
is a global data and technology company providing data-driven solutions across financial services, healthcare, automotive, agribusiness, insurance, and other markets.
What you will do
- Design, develop, and maintain large-scale data pipelines using Scala, Apache Spark, and cloud-native technologies.
- Build resilient distributed systems and optimize highly parallelized data processing workflows.
- Develop production-grade, tested, documented code and contribute to end-to-end feature delivery.
- Collaborate with engineers, product owners, and cross-functional stakeholders in agile value stream teams.
- Contribute to architecture discussions, code reviews, technical guidance, deployments, monitoring, and alerting.
- Improve the performance, cost efficiency, scalability, and reliability of petabyte-scale workloads.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Solid software or data engineering experience and hands-on experience with cloud-native data platforms such as AWS, GCP, or Azure.
- Experience with services such as S3, Glue, Athena, or equivalent, as well as distributed systems, resiliency patterns, data partitioning, and efficient data access.
- Experience designing and operating highly parallelized data workloads.
- Proficiency with Git-based version control and familiarity with agile, multi-team development.
- Advanced English proficiency and availability to travel to São Carlos, São Paulo, when needed are required.
Nice to have
- Experience with dbt or other data transformation frameworks.
- Knowledge of concurrent and parallel programming patterns.
- Expertise with Scala and Apache Spark for large-scale data pipelines.
- Experience with functional programming or Java, Python, or Rust.
- Familiarity with modern data platform architectures and large-scale data ecosystems.
Culture & Benefits
- Work in a global organization with 25,200 employees across 32 countries.
- People-centric, inclusive, and purpose-driven culture.
- Initiatives supporting inclusive recruitment and professional development.
- Affinity groups supporting LGBTQIAPN+ employees, racial equity, gender equity, people with disabilities, and generational inclusion.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →