Software Engineer (Distributed Systems/AI)

TL;DR

Software Engineer (Distributed Systems/AI): Building a new class of cloud infrastructure for AI by decoupling workloads from hardware with an accent on scheduling, routing, and resource management across heterogeneous compute. Focus on designing production-grade control planes, solving complex concurrency challenges, and optimizing system reliability at scale.

Location: San Francisco, CA; New York City, NY; San Jose, CA

Salary: $150,000 – $300,000

Company

A well-funded Series A startup building next-generation cloud infrastructure for AI workloads.

What you will do

• Own core distributed systems through the entire lifecycle from design and build to deployment and operation.
• Design scheduling, routing, and resource management systems operating across thousands of nodes.
• Build production-grade control planes and APIs for workload orchestration.
• Analyze and execute explicit tradeoffs regarding performance, reliability, and efficiency at scale.
• Debug complex distributed failures and continuously improve system behavior.

Requirements

• Experience building and operating distributed systems in production environments.
• Strong fundamentals in concurrency, systems design, and failure handling.
• Proven evidence of ownership over meaningful systems.
• Comfort reasoning about tradeoffs in large-scale environments.
• Ability to clearly explain design decisions and system behavior.

Nice to have

• Experience with Kubernetes or similar orchestration systems beyond basic usage.
• Background in scheduling, queues, or resource management systems.
• Experience designing service-oriented architectures, including RPC and async systems.
• Systems-level programming experience in Go, C++, or Python.