Member of Technical Staff - Evaluation Infrastructure (AI)

Location: Palo Alto, CA, United States

Base salary: $180,000–$440,000 USD per year

Company

Develops AI systems designed to understand the universe and support humanity’s pursuit of knowledge.

What you will do

• Build reliable, efficient, and easy-to-use infrastructure for running evaluations at scale.
• Collaborate with modeling and evaluation teams to develop new evaluations and maintain evaluation signal quality.
• Build internal tooling to support training next-generation AI models.
• Identify and resolve performance bottlenecks across inference, capacity fleet management, asynchronous evaluation orchestration, and related infrastructure layers.

Requirements

• Experience building, debugging, and optimizing large-scale distributed systems.
• Willingness to investigate and solve difficult problems across all levels of the technology stack.
• Strong communication, prioritization, and hands-on engineering skills.
• Ability to work from Palo Alto, California.

Nice to have

• Experience with LLM inference.
• Experience managing GPU compute, workload scheduling, and dynamic resource optimization.
• Experience developing interfaces for comparing models and evaluations.

Culture & Benefits

• Small, highly motivated organization focused on engineering excellence.
• Flat structure with hands-on contribution expected from all employees.
• Medical, vision, and dental coverage.
• 401(k) retirement plan, disability insurance, and life insurance.
• Equity, discounts, and other benefits.