3 дня назад
Data Engineer (Databricks)
65 000 - 80 000€
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks): Building and operating data pipelines and platform infrastructure that ingest auction data from APIs, services, and databases into Databricks on Azure with an accent on reliability, modular integration, and cost-effective operations. Focus on designing infrastructure as code, exposing data through APIs, containerizing workloads, and ensuring monitoring, data quality, and incident response.
Location: Amsterdam, Netherlands; hybrid
Salary: €65,000–€80,000 gross per year, including holiday allowance
Company
operates a digital B2B auction platform for used industrial equipment across nine brands and 175 countries, using auction technology, AI, and automation to support the circular economy.
What you will do
- Build and maintain Python ETL pipelines orchestrated with Airflow and processed in Databricks on Azure.
- Provision infrastructure with Terraform and deliver it through Azure DevOps pipelines and shared package artifacts.
- Build and integrate APIs with FastAPI or similar technologies for internal teams and services.
- Containerize workloads with Docker and operate them reliably in production.
- Document architecture, participate in RFC reviews, and translate stakeholder needs into technical specifications.
- Own monitoring, cost management, data quality, and incident response for delivered systems.
Requirements
- Strong Python skills with experience writing maintainable, tested, and reviewed code.
- Experience with Airflow or a comparable orchestration tool, Azure, Azure DevOps, and Databricks or a similar data platform.
- Experience with Terraform or another infrastructure-as-code tool, Docker, and dbt best practices.
- Knowledge of API design, data extraction from databases and services, Git, shell environments, debugging, and production containers.
- Working knowledge of networking concepts including DNS, TLS, firewalls, private endpoints, and VNets.
- Comfortable written English communication with colleagues across several countries.
Nice to have
- Experience in multi-brand, multi-country, or post-merger environments.
- Knowledge of analytical data modelling, Medallion architecture, or dimensional modelling.
- Experience with streaming or event-driven systems such as Kafka or Event Hubs.
- Experience with data governance, lineage, or cataloguing tools.
Culture & Benefits
- Established data platform with room for growth and meaningful ownership.
- Collaboration with data professionals from varied backgrounds and direct exposure to the business.
- Bonus scheme and pension scheme.
- 25 vacation days, laptop, and iPhone.
- Training opportunities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →