Senior Software Engineer (Streaming Platform)

TL;DR

Senior Software Engineer (Streaming Platform): Building and optimizing a high-performance Kafka-based streaming platform with an accent on reliability, cost efficiency, and usability at petabyte scale. Focus on scaling the Kafka fleet, designing control and data planes, and optimizing high-throughput application performance.

Location: Hybrid in New York, New York, USA

Salary: $192,000 — $240,000 USD

Company

Datadog is an observability and security platform for cloud-scale applications.

What you will do

• Operate a large-scale Kafka deployment, ensuring exceptional reliability through deep investigation of hardware and cloud-provider building blocks.
• Develop a high-performance streaming platform composed of control and data planes to reduce operational burden.
• Integrate open-source solutions with internal systems to optimize Kafka operations.
• Tweak low-level Kafka client behavior to maximize high-throughput application performance.
• Lead complex technical projects and ensure timely, high-quality delivery.
• Mentor junior team members and interns.

Requirements

• Experience delivering software solutions and libraries in Java or Golang.
• Proven experience building and operating large-scale stateful systems.
• Strong familiarity with distributed systems concepts such as consensus, quorums, and replication.
• Ability to operate independently, experiment methodically, and iterate rapidly.
• Strong communication skills for gathering requirements from stakeholders and leading initiatives.

Nice to have

• Direct experience operating or using large-scale streaming systems like Kafka.
• Familiarity with C++ or Rust.

Culture & Benefits

• Competitive compensation including new hire stock equity (RSUs) and an employee stock purchase plan (ESPP).
• Comprehensive health, dental, and mental health benefits for employees and dependents.
• 401(k) plan with company match.
• Continuous professional development, product training, and internal mentor/buddy programs.
• Inclusive environment with Community Guilds and internal Inclusion Talks.
• Hybrid work model to support work-life harmony.