обновлено 16 дней назад
Senior Data Engineer (Data Collection)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Data Collection) (Big Data/AWS): Designing and operating high-scale online and offline data ingestion pipelines that process billions of events daily, with an accent on reliability, scalability, data quality, and production infrastructure. Focus on solving distributed-system performance challenges, leading technical design decisions, and maintaining ingestion services across multiple servers.
Location: Tel Aviv-Yafo, Israel; hybrid work model
Company
provides a digital intelligence platform that reveals online behavior and helps more than 4,300 customers make data-driven digital strategy decisions.
What you will do
- Design, develop, and manage end-to-end online and offline data ingestion pipelines.
- Build and maintain modern data infrastructure using best practices for data pipeline development.
- Develop and operate high-scale ingestion services that process millions of requests per minute and billions of events daily.
- Monitor production availability, system health, reliability, and data quality.
- Own infrastructure features from design through production and solve complex scale, performance, and business-logic problems.
- Lead technical design decisions, conduct code reviews, mentor engineers, and collaborate with product managers and team leaders.
Requirements
- 5+ years of experience developing code for big data infrastructure.
- Proficiency with technologies such as Databricks, Spark, Airflow, Firehose, SQS, or similar tools.
- Experience working at high scale with AWS or another cloud provider.
- Experience designing large-scale, high-performance production systems.
- Ability to translate business requirements into technical alternatives, assess risks, and evaluate trade-offs.
- Strong communication skills and the ability to maintain effective dialogue across teams.
Culture & Benefits
- Hybrid work combining work-from-home flexibility with in-person collaboration.
- Competitive compensation and employee benefits.
- Regular team outings and social events.
- Career development through coaching, learning solutions, and opportunities to move across departments.
- Inclusive workplace focused on equality, mutual respect, and diversity.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 дней назад
Senior Solutions Engineer (Big Data)
8 дней назад
Big Data & Data Infrastructure Engineer (AI)
6 дней назад
Senior BI Engineer (Snowflake)
6 дней назад
Senior Data Platform Engineer (Python/LLM)
9 дней назад
Founding Data Engineer (AI Security)
7 дней назад