Tpu Kernel Engineer (AI)

Location: San Francisco, CA; New York City, NY; or Seattle, WA. Hybrid policy: staff are expected to work from one of the offices at least 25% of the time, with some roles requiring more office attendance.

Annual salary: $280,000–$850,000 USD

Company

Anthropic builds reliable, interpretable, and steerable AI systems intended to be safe and beneficial for users and society.

What you will do

• Identify and resolve performance issues across ML research, training, and inference systems.
• Design and optimize kernels for TPUs and other ML accelerators.
• Provide researchers with feedback on how model changes affect system performance.
• Implement low-latency, high-throughput sampling for large language models.
• Adapt models for low-precision inference and build quantitative system-performance models.
• Design collective communication algorithms and debug kernel performance at the assembly level.

Requirements

• Significant experience optimizing ML systems for TPUs, GPUs, or other accelerators.
• Experience solving large-scale systems problems and performing low-level optimization.
• Bachelor’s degree or an equivalent combination of education, training, and experience in a relevant field.
• Ability to collaborate through pair programming and communicate effectively in a research environment.
• Ability to work from one of the listed US offices at least 25% of the time.

Nice to have

• Experience with high-performance, large-scale ML systems.
• Experience designing and implementing kernels for TPUs or other ML accelerators.
• Deep understanding of accelerators, including computer architecture.
• Knowledge of ML framework internals and transformer-based language modeling.

Culture & Benefits

• Collaborative research environment with frequent research discussions and pair programming.
• Flexible working hours and an office designed for collaboration.
• Generous vacation and parental leave.
• Competitive compensation and benefits, including optional equity donation matching.
• Visa sponsorship is available, with immigration-lawyer support, although sponsorship cannot be guaranteed for every role or candidate.

Hiring process

• Candidates may use AI in the application process according to Anthropic’s candidate AI usage policy.