Назад
Company hidden
5 дней назад

Senior Data Engineer | Real-Time & Streaming

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
c1
Страна
Portugal
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer | Real-Time & Streaming (Apache Flink/Kafka): Build and operate production-grade real-time data products for the financial markets industry with an accent on stateful stream processing, resilient pipelines, APIs, and AWS operations. Focus on exactly-once processing, schema evolution, observability, security, and optimizing latency, throughput, reliability, and cost.

Location: Hybrid working model in Porto, Portugal

Company

hirify.global partners with organizations to drive digital transformation and build high-performing tech teams. This role supports a client operating in the financial markets industry.

What you will do

  • Design, build, and operate end-to-end real-time and batch data products using Apache Flink, Apache Kafka, and event-driven architectures.
  • Develop stateful stream-processing applications with windowing, event-time handling, watermarks, checkpointing, and exactly-once guarantees.
  • Manage ingestion, transformation, delivery pipelines, Kafka topics, partitioning, consumer groups, schemas, and schema evolution.
  • Build REST APIs, streaming interfaces, and microservices with contracts, versioning, authentication, and rate limiting.
  • Deploy and operate AWS services with Terraform, CI/CD, automated testing, observability, alerting, and safe rollback practices.
  • Monitor production services against SLAs, investigate incidents, improve performance and cost, review designs and code, mentor engineers, and contribute to technical standards.

Requirements

  • 7+ years of professional data engineering experience, including at least 3 years building and operating real-time or streaming systems in production.
  • Strong production experience with Apache Flink, including DataStream APIs and Flink SQL.
  • Strong Java skills; experience with Python/PyFlink or Scala is valued.
  • Strong Apache Kafka and event-driven architecture experience, including Avro and Schema Registry.
  • Experience building APIs and microservices with REST and OpenAPI.
  • Strong AWS experience, including services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS/EKS, S3, and IAM.
  • Strong SQL and data modelling skills across streaming and batch workloads.
  • Experience with GitLab CI or GitHub Actions and automated unit, integration, contract, and load testing.
  • Experience with CloudWatch, OpenTelemetry, Prometheus, and Grafana.
  • Fluent English, both written and spoken, is required.

Culture & Benefits

  • Hybrid working model in Porto.
  • Build production-grade real-time data products in the financial markets industry.
  • Own the full scope from streaming pipelines and APIs to production operations.
  • Collaborate with platform engineers, product owners, and business stakeholders.
  • Influence technical decisions, improve engineering practices, and mentor other engineers.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →