Member Of Technical Staff, Inference (AI)

TL;DR

Member Of Technical Staff, Inference (AI): Optimizing model inference systems and building reliable production serving systems with an accent on performance and scalability. Focus on system optimizations, algorithmic enhancements, and large-scale inference challenges.

Location: Must be based in or open to relocating to the Bay Area (San Francisco and Palo Alto)

Salary: $180,000 - $440,000

Company

xAI is focused on creating AI systems that enhance human understanding of the universe.

What you will do

• Optimize latency and throughput of model inference.
• Build reliable production serving systems for billions of users.
• Accelerate research on scaling compute in reinforcement learning.
• Engage in model-hardware co-design for next-gen architectures.

Requirements

• Experience with system optimizations for model serving.
• Familiarity with low-level optimizations for inference.
• Knowledge of algorithmic optimizations for inference.
• Experience with large-scale inference engines.
• Background in testing and reliability of inference services.