5 часов назад
Senior Data Engineer (AWS/Python)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AWS/Python): Building scalable batch and real-time data pipelines, platforms, lakes, and warehouses for unified data consumption with an accent on data architecture, modeling, quality, and infrastructure reliability. Focus on integrating structured and unstructured sources, optimizing Spark and Kafka-based systems, and supporting performance and SLA requirements.
Location: Hybrid work in Petah Tikva, Israel
Company
develops technologies for accident prevention and semi- and fully autonomous vehicles.
What you will do
- Design, build, and maintain scalable end-to-end data pipelines for batch and real-time use cases.
- Develop flexible data architectures, data platforms, data lakes, and data warehouses.
- Integrate structured and unstructured data sources using ETL and streaming solutions.
- Design data models, schemas, and SQL/NoSQL database structures.
- Implement data quality processes and monitor, optimize, and troubleshoot data infrastructure against performance and SLA requirements.
- Collaborate with analysts and stakeholders to deliver reliable data solutions and own data flows from ingestion to consumption.
Requirements
- 5+ years of hands-on Data Engineering experience, including building data systems from scratch.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Strong Python, advanced SQL, and data modeling skills.
- Experience building batch and real-time pipelines with streaming technologies such as Kafka.
- Experience with AWS services including S3, Athena, and DynamoDB; Spark, Parquet, and Airflow.
- Fluent English and the ability to work in a hybrid setup in Petah Tikva, Israel.
Nice to have
- Experience with Databricks and Snowflake.
- Experience building modern lakehouse platforms with technologies such as Iceberg.
Culture & Benefits
- Hands-on ownership of data infrastructure built from the ground up.
- Fast-paced environment with opportunities to solve ambiguous technical problems.
- Work supporting technologies for safer and increasingly autonomous driving.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →