Senior Software Engineer, Systems (AI)

TL;DR

Senior Software Engineer, Systems (AI): Building and maintaining systems that support AI clusters at massive scale with an accent on compute uptime and resilience. Focus on solving compute, networking, and reliability challenges, and contributing to operational practices.

Location: San Francisco, CA | New York City, NY | Seattle, WA. Expect all staff to be in one of our offices at least 25% of the time.

Salary: $300,000 - $405,000 USD

Company

hirify.global’s mission is to create reliable, interpretable, and steerable AI systems.

What you will do

• Lead infrastructure projects from design through delivery, owning scope, execution, and outcomes.
• Build and maintain systems that support AI clusters at massive scale (thousands to hundreds of thousands of machines).
• Partner with cloud providers and internal teams to solve compute, networking, and reliability challenges.
• Tackle difficult technical problems in your domain and proactively fill gaps in tooling, documentation, and processes.
• Contribute to operational practices including incident response, postmortems, and on-call rotations.

Requirements

• Have 6+ years of software engineering experience.
• Have led technical projects end-to-end over multiple months, including scoping, breaking down work, and driving delivery.
• Have deep knowledge of distributed systems, reliability, and cloud platforms (Kubernetes, IaC, AWS/GCP).
• Are strong in at least one systems language (Python, Rust, Go, Java).
• Solve hard problems independently and know when to pull others in.
• Communicate clearly in design docs, presentations, and cross-functional discussions.

Nice to have

• Security and privacy best practice expertise.
• Experience with machine learning infrastructure like GPUs, TPUs, or Trainium, as well as supporting networking infrastructure like NCCL.
• Low level systems experience, for example linux kernel tuning and eBPF.
• Technical expertise: Quickly understanding systems design tradeoffs, keeping track of rapidly evolving software systems.

Culture & Benefits

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.
• Lovely office space in which to collaborate with colleagues.