AI Systems Engineer (AI)

TL;DR

AI Systems Engineer (Distributed Systems): Designing a new execution layer for AI workloads with an accent on dynamic decomposition and real-time compute allocation. Focus on solving latency, throughput, and memory constraints at scale to push hardware to its physical limits.

Location: San Francisco, CA or New York City, NY

Salary: $200,000–$250,000

Company

An AI infrastructure company applying first-principles engineering to build a high-performance execution layer.

What you will do

• Design and build core systems from scratch to production.
• Develop an execution layer for dynamic workload decomposition and real-time compute allocation.
• Optimize how AI inference actually executes to maximize hardware performance.
• Solve complex latency, throughput, and memory constraints at scale.
• Define the foundational technical architecture of the company.

Requirements

• Exceptional backend and systems engineering fundamentals.
• Experience with distributed systems or performance-critical infrastructure.
• Ability to operate effectively in environments with high ambiguity and low structure.
• Strong bias toward building and implementation over discussion.
• Must be based in San Francisco, CA or New York City, NY

Nice to have

• Experience with AI/ML systems.
• Knowledge of compilers, runtimes, or GPU optimization.

Culture & Benefits

• Small, high-calibre team with a deep technical focus.
• Environment with no corporate fluff or unnecessary layers.
• Opportunity to perform foundational work that could become a standard for the AI industry.