Топовая возможность поработать с передовым AI-инференсом и распределенными системами в серьезных масштабах.
Передовой стек
Трендовый домен
Четкие задачи
?Зарплата не указана
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Senior Software Developer (AI): Building a next-generation platform for high-performance AI inference and model serving with an accent on distributed systems and inference optimization. Focus on optimizing SOTA open-source models, implementing cache-aware routing, and scaling serving architectures for production workloads.
Location: Amsterdam or London, or remote within Europe or the United States. The team meets in person every one to two months at one of its locations. Applicants must be authorized to work in the country in which they apply.
Company
Nebius builds a full-stack AI cloud platform for data processing, model training, inference, and production deployment.
What you will do
Onboard state-of-the-art open-source models into the Token Factory platform.
Build and operate reliable, scalable production infrastructure for large-scale AI model serving.
Develop advanced inference and systems optimizations, including cache-aware routing, KV-cache offloading, disaggregated serving, and autoscaling.
Maintain and extend inference framework forks such as vLLM and TRT-LLM.