A top-tier opportunity to work on the bleeding edge of AI inference and distributed systems at a massive scale.
Cutting-edge stack
Trendy domain
Clear role scope
?Salary not specified
Job description
Text:
Hirify AI/Original
TL;DR
Senior Software Developer (AI): Building a next-generation platform for high-performance AI inference and model serving with an accent on distributed systems and inference optimization. Focus on optimizing SOTA open-source models, implementing cache-aware routing, and scaling serving architectures for production workloads.
Location: Amsterdam or London, or remote within Europe or the United States. The team meets in person every one to two months at one of its locations. Applicants must be authorized to work in the country in which they apply.
Company
Nebius builds a full-stack AI cloud platform for data processing, model training, inference, and production deployment.
What you will do
Onboard state-of-the-art open-source models into the Token Factory platform.
Build and operate reliable, scalable production infrastructure for large-scale AI model serving.
Develop advanced inference and systems optimizations, including cache-aware routing, KV-cache offloading, disaggregated serving, and autoscaling.
Maintain and extend inference framework forks such as vLLM and TRT-LLM.