4 часа назад
Senior AI Systems Engineer (Inference)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior AI Systems Engineer (Inference): Building and scaling large-scale model inference systems with an accent on GPU fleet management, Kubernetes orchestration, and deployment pipelines. Focus on optimizing model efficiency, integrating new architectures, and ensuring high reliability for multimodal AI services.
Location: Redwood City, CA (Hybrid)
Company
is building unified general intelligence capable of generating, understanding, and operating in the physical world through multimodal AI.
What you will do
- Integrate new model architectures into the inference engine.
- Scale deployments across thousands of machines and optimize GPU utilization.
- Build internal tooling to measure, profile, and track inference jobs.
- Automate, test, and maintain inference services for maximum uptime.
- Collaborate with research and infrastructure teams to optimize model efficiency.
- Develop scheduling systems to manage workloads across clusters and hardware providers.
Requirements
- Strong Python and system-architecture skills.
- Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, or TensorRT-LLM.
- Experience with queues, scheduling, traffic control, and fleet management at scale.
- Proficiency with Linux, Docker, and Kubernetes.
- Familiarity with Redis and S3-compatible storage.
- Must be able to work in a hybrid capacity in Redwood City, CA.
Nice to have
- Experience with modern networking stacks including RDMA (RoCE, InfiniBand, NVLink).
- Background in high-performance large-scale ML systems (100+ GPUs).
- Knowledge of CUDA, FFmpeg, or multimedia processing.
Culture & Benefits
- Opportunity to work on cutting-edge multimodal AI and general intelligence.
- Collaborative environment spanning research, engineering, and infrastructure.
- Focus on high-scale systems and complex infrastructure challenges.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
3 дня назад
Senior Machine Learning Platform Engineer (AI)
3 дня назад
Customer Engineer (ML/AI)
170 000 - 199 000$
1 день назад
Senior Software Engineer, Agents (AI)
180 000 - 250 000$
3 дня назад
AI Engineer (Public Sector)
3 дня назад
Senior Performance Engineer (AI Inference)
3 дня назад