3 часа назад
Senior Engineer (Apache Flink)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Engineer (Apache Flink): Building and operating a real-time data platform that processes operational events into live analytics, routing inputs, and warehoused data with an accent on stateful Flink pipelines, CDC, Kafka, and database integrations. Focus on solving checkpoint failures, backpressure, state growth, sink performance, schema evolution, and delivery guarantees across production streaming systems.
Location: Remote from Ukraine, Armenia, or Poland
Company
is hiring for a team responsible for a real-time data platform.
What you will do
- Design, implement, deploy, and operate stateful Apache Flink streaming pipelines using keyed state, windows, watermarks, timers, side outputs, and custom sources and sinks.
- Build and maintain CDC pipelines with Flink CDC or Debezium, including snapshots, incremental capture, schema evolution, and downstream idempotency.
- Design and operate Kafka and Kafka Connect pipelines, including topics, partitions, connectors, schemas, converters, and dead-letter routing.
- Own data flows from Kafka through Flink to PostgreSQL, TimescaleDB, ClickHouse, and BigQuery, including schema design, batch tuning, idempotency, and observability.
- Diagnose production issues such as checkpoint failures, backpressure, state growth, sink slowness, autoscaler oscillation, and restart loops.
- Contribute to platform deployment and technical direction through Helm, ArgoCD, GKE, monitoring, code reviews, mentoring, and streaming architecture decisions.
Requirements
- 5+ years of professional software or data engineering experience and strong Java expertise.
- Production experience with Apache Flink and stateful real-time streaming pipelines.
- Strong Apache Kafka experience, including Kafka Connect, consumer groups, partitions, delivery guarantees, and schema management.
- Hands-on experience with Debezium or Flink CDC and production Kafka-to-Flink-to-database or data warehouse pipelines.
- Strong PostgreSQL knowledge and experience with ClickHouse or BigQuery.
- Experience deploying and operating production data workloads on Kubernetes, with expertise in troubleshooting consistency, idempotency, schema evolution, latency, lag, and observability issues.
Nice to have
- Experience with TimescaleDB, PostGIS, ClickHouse tuning, BigQuery optimization, or time-series and geospatial data.
- Experience with the Flink Kubernetes Operator, Flink autoscaler, ArgoCD, Helm, GKE, Prometheus, or Grafana.
- Experience designing high-throughput, low-latency streaming systems or working with MQTT and IoT/event-driven systems.
- Knowledge of Schema Registry, Avro, Protobuf, and advanced schema evolution.
- Experience with routing, logistics, delivery, mobility, location-based platforms, mentoring, or technical leadership.
Culture & Benefits
- Remote work from Ukraine, Armenia, or Poland.
- Flexible schedule with a high level of autonomy.
- 20 paid vacation days, 5 sick days, and public holidays.
- Opportunities to influence product and technical decisions.
- Professional growth, learning opportunities, and a supportive working environment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →