Senior Big Data Engineer (Location Analytics)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Big Data Engineer (Spark/Python): Designing, developing, and maintaining the data infrastructure for a location analytics platform with an accent on scalable data pipelines and performance optimization. Focus on building robust ETL processes, integrating large-scale data sources, and optimizing cloud-based storage and processing.
Location: Ramat Gan, Israel
Company
is a location analytics unicorn transforming how organizations understand the physical world through high-scale visibility into consumer behavior.
What you will do
- Design, build, and optimize robust and scalable data pipelines to process and integrate large volumes of data.
- Implement data validation, cleansing, and enrichment techniques to ensure high-quality platform data.
- Identify performance bottlenecks and optimize storage mechanisms to reduce latency.
- Manage scalable data infrastructure using GCP and AWS cloud technologies.
- Collaborate with Data Scientists, Product Managers, and Software Engineers to deliver business-critical solutions.
- Enforce data governance practices and ensure compliance with data privacy and security regulations.
Requirements
- 5+ years of professional software development experience, with at least 3 years specifically as a Data Engineer.
- Mandatory: Strong proficiency in Apache Spark and building data processing applications.
- Mandatory: Proficiency in PySpark or Scala for Spark development.
- Proven track record in designing ETL pipelines, data integration, and transformation processes.
- Hands-on experience with cloud platforms such as AWS, GCP, or Azure.
- Solid understanding of SQL, relational databases, and data modeling.
Nice to have
- Prior experience in the geospatial or location analytics domain.
- Familiarity with Hadoop ecosystem components and serialization formats like Parquet or Delta.
- Experience with orchestration tools like Apache Airflow.
Culture & Benefits
- Opportunity to join a fast-growing unicorn company in a pioneering market.
- Collaborative environment working alongside top-notch technical talent.
- Competitive salary and excellent benefits package.
- Culture of innovation and professional growth through mentorship.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →