Senior Kafka Integration Engineer (Kafka)

TL;DR

Senior Kafka Integration Engineer (Kafka): Architecting and implementing high-speed 'nervous system' for a data platform with an accent on resilient, low-latency integrations handling millions of events per second. Focus on deep-diving into Apache Kafka internals, tuning librdkafka configurations, and writing high-performance Go and Java code to ensure zero data loss and maximum throughput.

Location: Remote (Global)

Company

hirify.global is an American software development and technology advisory firm that brings top-tier engineering talent to clients around the world.

What you will do

• Design and build production-grade producers and consumers using Go (confluent-kafka-go) and/or Java, optimized for high-concurrency environments.
• Implement and manage advanced producer features, including idempotent delivery, custom partitioners, and tuned compression strategies.
• Optimize librdkafka parameters to balance latency and throughput.
• Architect complex consumer strategies, including manual offset management and static group membership.
• Implement "Exactly-Once Semantics" (EOS) and robust error-handling for mission-critical workflows.
• Develop custom metrics and instrumentation to monitor client-side performance and identify bottlenecks.

Requirements

• 5+ years of experience as Go (Golang) and/or Java engineer and expertise with Kafka.
• Expert proficiency in Go (Golang) and/or Java.
• Deep understanding of Kafka wire protocol, offset management, and partition leadership.
• Extensive experience with librdkafka and its wrappers, including troubleshooting the underlying C library and managing memory/thread safety.
• Proven track record of building distributed systems that handle 100k+ events/sec with sub-10ms latency.
• Experience with Azure DevOps or Jenkins for CI/CD, and Git for complex version control.
• Excellent verbal and written English communication skills.

Culture & Benefits

• Fully remote work with the option to come to one of our global offices.
• Join an excellent team of supportive engineers and project managers.
• Generous vacation schedule.
• Brand new laptop.
• Upbeat work environment.