7 дней назад
Inference Systems Engineer (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Inference Systems Engineer (AI) (large-scale model serving): Building and operating inference systems across thousands of machines with an accent on model architecture integration, GPU fleet utilization, scheduling, and deployment reliability. Focus on designing scalable scheduling systems, optimizing distributed inference workloads across clusters and hardware providers, and maintaining high-availability deployment pipelines.
Location: London, UK; Remote, UK. Hybrid work.
Company
builds unified general intelligence that can generate, understand, and operate in the physical world, with a focus on multimodal intelligence and vision.
What you will do
- Integrate new model architectures into the inference engine.
- Optimize model efficiency, deployments, and inference workloads across clusters and hardware providers.
- Build tooling to measure, profile, and track inference jobs and workflows.
- Automate, test, and maintain inference services for high uptime and reliability.
- Design scheduling systems that optimize expensive GPU resources while meeting internal SLOs.
- Maintain CI/CD pipelines for model checkpoints and SDKs.
Requirements
- Strong Python and systems architecture skills.
- Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar technologies.
- Experience with queues, scheduling, traffic control, and fleet management at scale.
- Experience with Linux, Docker, Kubernetes, orchestration, deployment, and scheduling.
- Familiarity with Redis and S3-compatible storage.
Nice to have
- Experience with modern networking stacks, including RDMA, RoCE, InfiniBand, or NVLink.
- Experience with large-scale machine learning systems using 100 or more GPUs.
- Experience with CUDA, FFmpeg, or multimedia processing.
Culture & Benefits
- Work across research, engineering, and infrastructure functions.
- Contribute to multimodal intelligence and vision-focused AI systems.
- Full-time hybrid work arrangement in the UK.
- Equal opportunity employment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →