Member Of Technical Staff (AI)
ΠΡΡΡ & Π‘ΠΎΠΏΡΠΎΠ²ΠΎΠ΄
ΠΠ»Ρ ΠΌΡΡΡΠ° Ρ ΡΡΠΎΠΉ Π²Π°ΠΊΠ°Π½ΡΠΈΠ΅ΠΉ Π½ΡΠΆΠ΅Π½ Plus
ΠΠΏΠΈΡΠ°Π½ΠΈΠ΅ Π²Π°ΠΊΠ°Π½ΡΠΈΠΈ
TL;DR
Member of Technical Staff (AI): Design, build, and operate large-scale GPU infrastructure for high-throughput model inference and mid-training workloads with an accent on synthetic data generation and reinforcement learning pipelines at scale. Focus on improving performance of model execution through kernel-level optimization, model parallelism strategies, and GPU runtime improvements.
Location: San Francisco; London; New York
Company
Reflectionβs mission is to build open superintelligence and make it accessible to all.
What you will do
- Design, build, and operate large-scale GPU infrastructure for high-throughput model inference and mid-training workloads.
- Develop systems that power synthetic data generation and reinforcement learning pipelines at scale.
- Build high-performance inference platforms capable of serving and evaluating models across thousands of GPUs.
- Optimize throughput, latency, and GPU utilization for large language model inference and rollout workloads.
- Improve performance of model execution through kernel-level optimization, model parallelism strategies, and GPU runtime improvements.
- Diagnose and resolve performance bottlenecks across inference runtimes, GPU kernels, networking, and distributed compute systems.
Requirements
- Experience deploying and operating large-scale GPU systems for inference or model serving.
- Several years of hands-on experience building and running production infrastructure.
- Strong understanding of GPU performance characteristics and optimization techniques.
- Experience working with modern inference frameworks such as SGLang, Megatron, or similar high-performance LLM runtimes.
- Familiarity with distributed reinforcement learning infrastructure or rollout generation systems.
Culture & Benefits
- Top-tier compensation: Salary and equity structured to recognize and retain the best talent globally.
- Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance.
- Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys.
- Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time.
- Opportunities to connect with teammates: lunch and dinner are provided daily.
ΠΡΠ΄ΡΡΠ΅ ΠΎΡΡΠΎΡΠΎΠΆΠ½Ρ: Π΅ΡΠ»ΠΈ ΡΠ°Π±ΠΎΡΠΎΠ΄Π°ΡΠ΅Π»Ρ ΠΏΡΠΎΡΠΈΡ Π²ΠΎΠΉΡΠΈ Π² ΠΈΡ ΡΠΈΡΡΠ΅ΠΌΡ, ΠΈΡΠΏΠΎΠ»ΡΠ·ΡΡ iCloud/Google, ΠΏΡΠΈΡΠ»Π°ΡΡ ΠΊΠΎΠ΄/ΠΏΠ°ΡΠΎΠ»Ρ, Π·Π°ΠΏΡΡΡΠΈΡΡ ΠΊΠΎΠ΄/ΠΠ, Π½Π΅ Π΄Π΅Π»Π°ΠΉΡΠ΅ ΡΡΠΎΠ³ΠΎ - ΡΡΠΎ ΠΌΠΎΡΠ΅Π½Π½ΠΈΠΊΠΈ. ΠΠ±ΡΠ·Π°ΡΠ΅Π»ΡΠ½ΠΎ ΠΆΠΌΠΈΡΠ΅ "ΠΠΎΠΆΠ°Π»ΠΎΠ²Π°ΡΡΡΡ" ΠΈΠ»ΠΈ ΠΏΠΈΡΠΈΡΠ΅ Π² ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠΊΡ. ΠΠΎΠ΄ΡΠΎΠ±Π½Π΅Π΅ Π² Π³Π°ΠΉΠ΄Π΅ β