обновлено 1 день назад
Senior Data Engineer (Data Collection)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Data Collection) (Databricks/Spark/Airflow): Building and operating large-scale online and offline data ingestion pipelines that process millions of requests per minute and billions of events daily with an accent on reliability, scalability, and data quality. Focus on designing high-performance AWS infrastructure, solving availability and performance challenges, and owning ingestion features from architecture through production.
Location: Tel Aviv-Yafo, Israel; hybrid work model
Company
provides a digital intelligence platform that reveals online activity and supports data-driven decisions for thousands of customers worldwide.
What you will do
- Design, code, and manage end-to-end online and offline data ingestion pipelines.
- Develop and maintain modern data infrastructure for high-scale ingestion services.
- Address availability, reliability, scalability, performance, and business-logic challenges.
- Monitor production systems, system health, and data quality across pipelines processing billions of events daily.
- Lead technical design and decision-making, conduct code reviews, and improve implementation quality.
- Collaborate with product managers and engineering leaders while mentoring other engineers.
Requirements
- 5+ years of experience developing code for big data infrastructure.
- Proficiency with technologies such as Databricks, Spark, Airflow, Firehose, SQS, or similar tools.
- Experience operating high-scale systems on AWS or another cloud provider.
- Experience with the architecture and design of large-scale, high-performance production systems.
- Ability to translate business requirements into technical alternatives, assess risks, and evaluate trade-offs.
- Strong communication skills and ability to maintain effective dialogue between teams.
Culture & Benefits
- Hybrid work combining flexibility from home with face-to-face collaboration.
- Competitive compensation and benefits.
- Regular team outings and social events.
- Career development through coaching, learning solutions, and internal growth opportunities.
- Open dialogue, employee initiative, inclusivity, and respect for diverse backgrounds.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →