13 дней назад
Lead Data Mesh Engineer (Kafka/NiFi)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Mesh Engineer (Kafka/NiFi): Building an enterprise-grade Everything-as-Code Data Mesh with high-throughput asynchronous event streaming and hybrid data pipelines with an accent on AWS MSK, Apache NiFi, declarative GitOps, and contract-first schema governance. Focus on architecting multi-cloud streaming infrastructure, optimizing cross-cloud data movement, implementing resilient DLQ replay loops, and propagating distributed tracing context.
Location: Hungary — remote, with a hybrid work arrangement indicated
Company
provides enterprise data management and analytics solutions that help organizations transform complex data into actionable insights.
What you will do
- Architect, provision, and operate multi-AZ AWS MSK clusters and Apache NiFi runtimes on Amazon EKS using Terraform and declarative GitOps.
- Build an enterprise-grade Everything-as-Code Data Mesh and high-throughput asynchronous event-streaming infrastructure across multi-cloud environments.
- Implement contract-first schema governance with AWS Glue or Apicurio, Apache Avro, and AsyncAPI.
- Optimize partitioning, storage auto-scaling, compression, cross-cloud data movement, and compute consumption.
- Build fault-tolerant Dead Letter Queue replay loops and propagate out-of-band tracing context across service hops.
- Integrate cloud event meshes with enterprise lakehouses and big-data platforms such as CDP, Hadoop, and Hive.
Requirements
- Bachelor’s or master’s degree in a related field, or equivalent experience.
- 6+ years of hands-on experience architecting and operating Apache Kafka, preferably AWS MSK, and Apache NiFi in Kubernetes environments such as EKS.
- Advanced proficiency with Terraform and GitOps tools including ArgoCD or Flux.
- Expertise in Apache Avro, AsyncAPI, schema registries, and Master Data Management enforcement.
- Experience integrating cloud event meshes with enterprise data lakehouses or big-data platforms.
- Practical knowledge of OpenTelemetry and W3C distributed tracing context propagation.
Nice to have
- Exposure to Policy-as-Code tools such as Open Policy Agent and Rego.
Culture & Benefits
- Flexible work-from-home policy.
- Generous paid time off and Unplugged Days supporting work-life balance.
- Mental and physical wellness programs.
- Phone and internet reimbursement.
- Continued career development, comprehensive benefits, and competitive packages.
- Paid volunteer time and employee resource groups.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →