Principal Apache Spark Engineer

Формат работы

remote (Global)

Тип работы

fulltime

Грейд

principal

Английский

Вакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:

TL;DR

Principal Apache Spark Engineer: Developing and optimizing distributed data processing systems and real-time analytics with an accent on Apache Spark, Kafka, Hive, and scalable architecture. Focus on contributing to open source projects, performance tuning, and building streaming analytics capabilities.

Location: Remote

Company

hirify.global is a global technology company delivering cutting-edge solutions with a diverse team of top tech talent.

What you will do

Contribute as a core contributor to Apache Spark and related open source projects.
Design and optimize distributed data processing engines for batch and real-time analytics.
Develop streaming analytics using Spark Structured Streaming and Apache Kafka integration.
Enhance Spark SQL catalyst optimizer and distributed query execution.

Requirements

Advanced English proficiency required.
10+ years of software development experience.
Strong expertise in distributed computing and large-scale data processing.
Proficiency in Scala, Java, and Python.
Experience with Apache Spark architecture and performance tuning.
Core contributions to Apache open source projects.

Culture & Benefits

Excellent compensation in USD or local currency.
Paid parental leave, vacation, and national holidays.
Innovative and multicultural work environment.
Collaboration with global top 1% tech talent.
Supportive environment with mentorship and growth opportunities.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →