Member of Technical Staff, GPU Infrastructure (AI)

Location: Remote; listed locations include Seattle, Canada, New York, and California.

Salary: $270K–$335K annually, plus equity.

Company

Cohere is a security-first enterprise AI company building foundation models and end-to-end AI products for real-world business applications.

What you will do

• Deploy and operate multi-cloud GPU and TPU Kubernetes clusters for foundation-model workloads.
• Bring up new hardware generations and cloud providers while improving reliability, performance, and cost.
• Partner with cloud providers and hardware vendors on RDMA and high-speed interconnects.
• Automate node, GPU, and fabric fault detection and remediation.
• Improve fleet utilization, reduce costs, and shorten faulty-node recovery time.
• Troubleshoot production failures and performance issues; participate in a compensated 24x7 on-call rotation.

Requirements

• Experience running GPU Kubernetes clusters with thousands of GPUs for ML or HPC workloads.
• Experience debugging Linux, networking, and performance problems.
• Programming experience in Python or Go, with a preference for extending established open-source projects.
• Experience collaborating with researchers, ML engineers, or teams with differing goals.
• Ability to identify bottlenecks, propose fixes, and drive implementation in a fast-moving environment.

Nice to have

• Familiarity with RDMA, NCCL, or accelerator health.

Culture & Benefits

• Remote-friendly work with co-working support for employees away from an office and a $500 home-office stipend.
• Health and dental benefits, mental-health budget, RRSP matching, 401K, and pension scheme.
• Six weeks of paid vacation, parental-leave top-up of up to six months, and annual enrichment and learning benefits.
• Weekly lunch stipend of $75/£75 or equivalent in local currency.
• Remote employees receive travel support for other offices and an annual company offsite.

Hiring process

• Applicants may be screened and assessed using AI-enabled tools; accommodation requests can be submitted through the provided accommodations process.