Member of Technical Staff - Mid-training (AI)

Location: Palo Alto, California, United States

Salary: $180,000–$440,000 USD per year

Company

xAI develops AI systems designed to understand the universe and support humanity's pursuit of knowledge.

What you will do

• Scale synthetic coding data to trillions of tokens using large-scale Docker verification.
• Generate synthetic data to distill flagship-model intelligence into flash models.
• Optimize mid-training data mixtures to increase the ceiling for reinforcement learning.
• Engineer data recipes for long-context training.
• Develop robust and diverse evaluations for mid-training checkpoints.

Requirements

• Expertise in machine learning and large-model scaling, including familiarity with scaling laws.
• Strong ability to design and run machine-learning experiments.
• Familiarity with state-of-the-art techniques for curating AI training data across text, image, audio, and video modalities.
• Strong engineering skills with Spark, Ray, and other large-scale data-processing frameworks.
• Strong communication, prioritization, and hands-on engineering skills.

Culture & Benefits

• Small, highly motivated organization focused on engineering excellence and curiosity.
• Flat organizational structure with hands-on contribution expected from all employees.
• Leadership opportunities based on initiative and consistent delivery.
• Equity and comprehensive medical, vision, and dental coverage.
• 401(k) retirement plan, short- and long-term disability insurance, life insurance, discounts, and other perks.