Senior Data Infrastructure Engineer (Data Lake)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Infrastructure Engineer (Data Lake): Designing and building a self-hosted greenfield data lake to aggregate infrastructure metrics, business transactions, and logs with an accent on open-source storage and processing layers. Focus on creating scalable data pipelines, defining storage architectures, and integrating diverse data sources into a single foundation.
Location: Hybrid (Rotterdam office). A valid EU work permit is required; relocation support is available.
Company
provides world-class global interconnected network solutions focusing on low latency and scalability for game developers and businesses.
What you will do
- Design the Data Lake architecture, selecting open-source tools for storage, ingestion, and transformation layers.
- Build reliable data pipelines to ingest infrastructure metrics, business systems, application logs, and financial data.
- Design schemas and transformation layers to make raw data usable, consistent, and queryable.
- Integrate the platform with MariaDB, Prometheus, OpenSearch, RabbitMQ, and internal APIs.
- Own the reliability, monitoring, alerting, and capacity planning of the data platform.
- Collaborate with Platform, Infrastructure, Network, and Product teams to make data accessible.
Requirements
- 6-8 years of experience building and operating data pipelines and storage layers in production environments.
- Hands-on experience with self-hosted open-source tools such as Spark, Airflow, and Trino.
- Proven experience building data infrastructure from scratch (greenfield projects).
- Strong proficiency in SQL and data modeling for analytical performance.
- Comfortable with Linux (Debian), containers, and Kubernetes.
- Must possess a valid EU work permit.
Culture & Benefits
- Greenfield opportunity to design a global-scale platform on real hardware with full ownership of architectural calls.
- Competitive package including annual bonus, 25 vacation days, travel allowance, and a pension plan.
- Professional growth through education reimbursement and career guidance.
- Access to an in-house gym in the Rotterdam office.
- Lifetime access to Ubisoft’s game library.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →