2 дня назад
Senior Data Engineer (AWS/Python)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AWS/Python): Designing and delivering production-grade data pipelines and cloud infrastructure for Kpler’s marine insurance initiative with an accent on large-scale data ingestion, event streaming, and platform reliability. Focus on setting data architecture direction, deploying containerized AWS services, mentoring engineers, and building resilient observability and monitoring systems.
Location: United Kingdom; Workplace: Hybrid
Company
develops a global market intelligence platform using large-scale data and cloud infrastructure for maritime, logistics, and related markets.
What you will do
- Design, deploy, operate, monitor, and maintain production-grade data pipelines and infrastructure end to end.
- Build and containerize AWS applications using Python, Docker, Kubernetes, Airflow, and Terraform.
- Architect PostgreSQL data structures and Kafka/Flink event-streaming flows to ensure data integrity.
- Set technical direction through architecture design, peer reviews, and resilient logging, monitoring, and alerting frameworks.
- Collaborate with engineers, product managers, and data scientists while mentoring peer engineers.
- Evaluate and implement modern data infrastructure tools and frameworks.
Requirements
- At least 5 years of experience designing, operating, and owning production-grade data pipelines and infrastructure.
- Strong Python skills and hands-on experience with Docker, Kubernetes, AWS, Airflow, and PostgreSQL.
- Practical experience with Kafka or Flink, Terraform, CI/CD, and production logging and monitoring systems.
- Ability to lead architectural discussions, mentor engineers, and use AI-assisted coding tools such as Copilot, Cursor, or Claude with sound technical judgment.
- Experience in Agile environments with strong collaboration skills.
- Fluent written and spoken English is required.
Nice to have
- Experience building large-scale data processing or analytics platforms.
- Experience leading technical initiatives across multiple teams.
- Knowledge of commodities, shipping, energy, or marine insurance market data.
Culture & Benefits
- Hybrid work arrangement in the United Kingdom.
- Collaborative work with engineering, product, and data science teams.
- Opportunities to mentor engineers and influence technical standards.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →