Software Engineer II - Core Ingest (Distributed Systems)

TL;DR

Software Engineer II - Core Ingest (Distributed Systems): Designing and implementing high-volume, fault-tolerant backend systems for a distributed data platform with an accent on low-latency processing and scalability. Focus on optimizing cluster load algorithms and re-architecting internal message processing to handle petabyte-scale data.

Location: Remote or Hybrid (Must be authorized to work in the United States; no visa sponsorship available)

Salary: $116,000 - $136,000 per year

Company

hirify.global provides an AI-powered Intelligent Operations Platform that unifies security and operational data for modern cybersecurity and cloud operations.

What you will do

• Design and implement scalable, fault-tolerant backend systems processing petabytes of customer data.
• Improve algorithms for elastic load scheduling across thousands of machine clusters.
• Optimize systems to provide performance guarantees in a multi-tenant architecture.
• Re-architect internal message processing technology to reach petabyte-per-day scale.
• Manage massive datasets using technologies such as Kafka, Kubernetes, and Docker.
• Collaborate with Search, Security, and Metrics teams to architect core ingest solutions.

Requirements

• B.S. or higher in Computer Science or a related discipline.
• 2+ years of industry experience with a proven track record of delivery.
• Experience developing scalable distributed data processing solutions and microservices architecture.
• Proficiency in multi-threaded programming and object-oriented languages like Java or Scala.
• Must be authorized to work in the United States for the duration of employment.
• Willingness to participate in an on-call rotation every 6-8 weeks.

Nice to have

• Experience with big data or 24x7 commercial services.
• Hands-on experience with Apache Kafka.
• Proficiency with Unix environments (Linux, OS X).
• Experience with Agile and Test-Driven Development (TDD).

Culture & Benefits

• Support for both remote and hybrid work arrangements.
• Eligibility for bonus or commission plans.
• Corporate benefits offerings and equity awards.
• Opportunity to work with a highly distributed, fault-tolerant, multi-tenant platform at exabyte scale.