Назад
Company hidden
3 дня назад

Senior Engineer - Software Engineering (Data Engineering)

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
UK/Netherlands
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Engineer - Software Engineering (Data Engineering) (Airflow/Python/Kubernetes): Modernising and consolidating business-critical data pipelines and job scheduling on Apache Airflow and Kubernetes with an accent on production-grade Python, data quality, and regulated financial workflows. Focus on migrating scheduling platforms, operating containerised workloads, building reliable DAGs, and applying AI-assisted development in a production-critical environment.

Location: Amsterdam, Netherlands or London, United Kingdom; mostly on-site. The team works from the Amsterdam office four days a week and one day from home.

Company

Cboe Clear Europe is a systemically important central counterparty providing post-trade services, clearing, settlement, risk and reporting infrastructure for European and international financial markets.

What you will do

  • Modernise and consolidate batch and data-job scheduling onto a standard Apache Airflow and Kubernetes platform.
  • Design, develop and operate Airflow DAGs for price data, risk inputs, settlement and regulatory and customer reporting.
  • Build tested, typed and reusable Python pipeline logic, custom operators, hooks and shared libraries.
  • Deploy and troubleshoot containerised Airflow and pipeline workloads on Kubernetes using Docker, Helm and CI/CD.
  • Implement data-quality monitoring, alerting, SLAs, dependencies, retries and operational safeguards.
  • Use Claude Code and similar AI agents for development, testing, documentation and operations while helping define team standards and guardrails.

Requirements

  • Seasoned data-engineering experience building, running and troubleshooting pipelines for business-critical systems.
  • Solid production experience with Apache Airflow, including DAG design, scheduling, backfills, sensors, dynamic tasks and custom operators.
  • Strong production Python with testing using pytest, packaging and type hints.
  • Hands-on experience deploying and debugging containerised workloads on Kubernetes with Docker and Helm.
  • Practical experience with AI-assisted development using Claude Code or a similar coding agent, including careful review of generated output.
  • Experience migrating or consolidating jobs between scheduling or processing platforms without disrupting business operations.
  • Good SQL and data-modelling skills, plus prior experience in a regulated environment such as financial services.
  • Strong English communication skills; Dutch is not required.
  • Bachelor’s or master’s degree in a relevant field, or equivalent practical experience.

Nice to have

  • Knowledge of post-trade, clearing, CCP operations or market data.
  • Experience running Airflow at scale on Kubernetes, including KubernetesExecutor, KubernetesPodOperator or the official Helm chart.
  • PySpark and exposure to reporting platforms such as Snowflake.
  • Experience with enterprise job schedulers and moving workloads away from them.
  • Experience extending AI coding agents through skills, hooks or MCP servers.
  • Experience creating lasting improvements in Data Governance or Data Quality Management.
  • Observability experience with Prometheus, Grafana or OpenLineage.

Culture & Benefits

  • Small, senior, international team focused on collaboration, ownership, transparency and entrepreneurial spirit.
  • Work from the Amsterdam office four days per week and from home one day per week, with pragmatic flexibility when needed.
  • Training and development opportunities in data engineering, AI and regulated production systems.
  • Competitive salary and bonus programme, premium pension plan, paid lunch at the office, travel allowance and work-from-home allowance.
  • Collaboration with Cboe teams across the globe to share reusable components and align technology choices.

Hiring process

  • Apply through the official Cboe careers site.
  • Valid communication about this position will only come from a Cboe recruiter using a @cboe.com email address or LinkedIn Recruiter; Cboe does not use other third-party recruiting communication tools.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →