Senior Data Engineer (Big Data)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (Big Data): Designing and scaling data infrastructure for a high-traffic omnichannel advertising platform with an accent on ETL/ELT pipelines and cloud-native storage. Focus on processing billions of daily ad impressions using Apache Spark and managing massive datasets on GCP and AWS.
Location: Hybrid in Netanya, Israel (3 days per week in office)
Company
is a leading omnichannel advertising platform that leverages predictive AI to connect quality media and brand creative for thousands of publishers and advertisers globally.
What you will do
- Design, build, and maintain robust and scalable ETL/ELT pipelines using Apache Spark.
- Architect and manage data infrastructure on GCP (BigQuery, GCS) and AWS (S3, EMR, AirFlow).
- Enhance and manage data warehouse and data lake solutions for business intelligence and machine learning.
- Implement monitoring, alerting, and logging systems to maintain data pipeline health and accuracy.
- Collaborate with data scientists, analysts, and server-side engineers to deliver next-generation ad tech solutions.
Requirements
- 5+ years of data engineering experience building and operating production data pipelines at scale (TB+ datasets).
- Hands-on production experience with Apache Spark and distributed processing frameworks (Flink, Hive, or Trino).
- Proficiency in Scala, Python, or Java for shipping production Spark code.
- Production experience building and operating data solutions on GCP or AWS.
- Experience with Kafka or Kafka-compatible streaming platforms and real-time data pipelines.
- Strong understanding of data warehouse/lake concepts, including Medallion Architecture.
Nice to have
- Production experience with lakehouse table formats such as Apache Iceberg or Delta Lake.
Culture & Benefits
- Hybrid working model (3 days per week in the office).
- Mentorship program and internal learning tools to expand your technical toolbox.
- Pet-friendly office environment.
- Fully stocked kitchen and regular happy hours.
- Collaborative and diverse global company culture.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →