обновлено 6 дней назад
Senior Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Python/Spark): Building scalable data pipelines, processing systems, and reusable datasets for a data-driven technology company with an accent on reliability, data quality, performance, and large-scale processing. Focus on optimizing batch and streaming architectures, improving query and processing efficiency, and developing monitoring and validation for distributed data platforms.
Location: Onsite in Paris, France
Company
Innovative technology business building scalable products and reliable data infrastructure in a fast-paced, data-driven environment.
What you will do
- Design, build, and maintain scalable data pipelines and processing systems.
- Improve data reliability, quality, performance, and operational monitoring.
- Develop automated processes to validate and monitor data.
- Create reusable datasets and data solutions for internal engineering teams.
- Optimize data-processing workloads for performance, reliability, and cost.
- Contribute to broader data engineering practices and capabilities.
Requirements
- Several years of experience designing, developing, and supporting production-grade data pipelines.
- Strong hands-on experience with Python and SQL, plus Scala or a comparable programming language.
- Practical experience with Apache Spark, PySpark, Spark SQL, and stream-processing technologies.
- Familiarity with Parquet, Apache Iceberg, data lakes, large-scale storage platforms, and curated datasets.
- Understanding of batch and streaming trade-offs, distributed processing architecture, query performance, and data-processing efficiency.
- Strong knowledge of data quality, reliability, monitoring, and operational best practices.
Nice to have
- Experience with Apache Flink or comparable stream-processing frameworks.
- Experience supporting machine-learning training or inference data pipelines.
- Familiarity with recommendation systems, ranking, embeddings, or entity matching and resolution.
- Experience with privacy-sensitive datasets and data retention, deletion, export, or regulatory requirements.
Culture & Benefits
- Competitive salary package with equity for all employees.
- Comprehensive healthcare coverage and enhanced parental leave.
- Generous annual holiday allowance and company-wide shutdown periods.
- Collaborative working environment in a modern Paris office.
- Inclusive workplace with accessibility adjustments available during the application and interview process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →