Engineering Manager, Storage Products (AI)

Location: Hybrid in San Francisco, United States

Salary: $165,000–$330,000 per year, plus equity

Company

Baseten builds AI inference infrastructure, combining applied AI research, flexible infrastructure, and developer tooling to help companies deploy cutting-edge models in production.

What you will do

• Lead and grow a team of 5–10 systems engineers working on storage, caching, and Linux infrastructure.
• Own the architecture and evolution of the Baseten Delivery Network, improving model and container delivery and reducing cold starts.
• Develop storage products for model weights, container images, training checkpoints, and deployment artifacts.
• Guide lazy-loading snapshotters, filesystem layouts, and block-level delivery using technologies such as EROFS, FUSE, and ublk.
• Own reliability measurement, instrumentation, incident response, and safe rollouts across heterogeneous clusters and cloud providers.
• Coordinate storage dependencies and interfaces with infrastructure, model deployment, training, product, and upstream open-source teams.

Requirements

• Experience managing engineers in systems, infrastructure, or storage contexts, including hiring and performance management.
• Hands-on experience with distributed storage systems, content-addressable storage, or large-scale caching infrastructure.
• Strong systems programming background in Go, Rust, and/or C/C++, with the ability to participate in code reviews and architecture discussions.
• Working knowledge of the Linux storage stack, including filesystems, page cache, block devices, and mounts.
• Understanding of how container images are structured, stored, and delivered at scale.
• Strong written and verbal communication skills and the ability to influence across teams.

Nice to have

• Contributions to containerd, snapshotter, distribution, or related open-source projects.
• Experience with lazy-loading snapshotters, peer-to-peer image distribution, EROFS, FUSE, ublk, or io_uring.
• Experience building or operating CDN, object storage, or large-scale caching infrastructure.
• Experience running storage services on Kubernetes.

Culture & Benefits

• Competitive compensation with meaningful equity.
• U.S. employees and dependents receive full medical, dental, and vision coverage.
• Flexible PTO and a company-wide Winter Break.
• Paid parental leave and a fertility and family-building stipend.
• Company-facilitated 401(k) for U.S. employees.
• Exposure to a range of ML startups and opportunities to contribute to the containerd and snapshotter ecosystem.