Назад
Company hidden
7 дней назад

Staff Engineer — Data Platform

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Israel
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff Engineer — Data Platform (Spark/Iceberg/Kafka): Building and evolving a large-scale data platform powering reporting, billing, ML training, experimentation, revenue optimization, and business decision-making with an accent on reliability, freshness, scalability, and ease of use. Focus on solving Spark performance and cost challenges, managing Iceberg lakehouse tables, operating high-throughput Kafka pipelines, and delivering low-latency StarRocks analytics.

Location: Tel Aviv, Israel; hybrid schedule with 3 days in the office.

Company

hirify.global provides performance advertising technology and data-driven ad solutions for businesses, publishers, and advertisers at global scale.

What you will do

  • Shape the architecture, technical direction, roadmap, and technology choices of the Data Platform group.
  • Build and operate large-scale distributed data systems supporting reporting, billing, ML training, experimentation, revenue optimization, and business decisions.
  • Own complex platform challenges across Spark performance and cost optimization, Iceberg table management, Kafka ingestion, and low-latency StarRocks analytics.
  • Evolve the Spark SQL platform, lakehouse, ingestion, storage, compaction, serving, and shared framework code.
  • Raise standards for design, code quality, testing, observability, and operational excellence while remaining hands-on with production code, prototypes, and new technologies.
  • Mentor engineers, lead design reviews and postmortems, influence stakeholders across R&D, and represent the group in architecture forums, hiring, open-source communities, and conferences.

Requirements

  • 10+ years of hands-on software engineering experience, with deep expertise in Java or an equivalent JVM/object-oriented language.
  • Deep hands-on Apache Spark expertise, including internals, Spark SQL, the Catalyst optimizer, and performance and cost tuning at scale.
  • Production experience with Apache Iceberg or another open table format, including table design, partitioning, compaction, and metadata/catalog management.
  • Deep Apache Kafka expertise, including internals, partitioning, delivery semantics, and operating high-throughput production pipelines.
  • Hands-on experience with StarRocks or a similar MPP/real-time analytics engine, such as Druid, ClickHouse, or Trino.
  • Experience designing, building, and owning large-scale distributed data systems end to end, from architecture through production reliability.
  • Experience mentoring engineers and growing technical leaders through design reviews, code reviews, pairing, and knowledge sharing.
  • Ability to influence without authority and align teams, managers, and stakeholders; highly proficient with Linux and Kubernetes in production.
  • Ability to lead by example with AI by introducing agent-based engineering workflows, measuring their impact, and helping the group adopt them.
  • B.Sc. in Computer Science or equivalent experience.

Nice to have

  • Contributions to open-source data projects such as Spark, Iceberg, Kafka, or StarRocks; conference talks, blog posts, or other public technical writing.
  • Experience running Spark on GPU with RAPIDS or using other query acceleration techniques.
  • Experience with stream processing using Spark Structured Streaming, Kafka Streams, or Flink.
  • Experience with dbt and/or Airflow, and knowledge of Ansible, Puppet, or similar configuration systems.
  • Experience leveraging AI agents to accelerate engineering work.
  • Familiarity with how ML training pipelines consume data for effective collaboration with algorithm teams.

Culture & Benefits

  • Hybrid work schedule with 3 days in the office and the option to attend more often.
  • Region-tailored competitive benefits, comprehensive health benefits, well-being programs, a stocked kitchen, and location-specific perks.
  • Environment focused on employee growth, learning, empowerment, inclusion, and collaboration with experienced engineers.
  • Opportunity to work with major publisher partners and advertiser clients through a large-scale performance advertising platform.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →