4 месяца назад
Staff + Senior Software Engineer (Inference Deployment)
320 000 - 485 000$
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff + Senior Software Engineer (Inference Deployment) (Distributed AI Inference): Building high-performance distributed systems and deployment infrastructure that serve Claude to millions of users with an accent on intelligent routing, fleet-wide orchestration, and compute efficiency. Focus on designing autoscaling and traffic-management systems across AI accelerators, integrating new inference hardware and model architectures, and operating reliable model-release pipelines.
Location: San Francisco, CA; New York City, NY; or Seattle, WA. Hybrid policy requires staff to work from one of the offices at least 25% of the time.
Annual salary: $320,000–$485,000 USD
Company
Anthropic builds reliable, interpretable, and steerable AI systems designed to be safe and beneficial for users and society.
What you will do
- Design, build, and maintain distributed systems serving Claude to millions of users.
- Develop intelligent request routing, load balancing, traffic management, and resilient real-time systems across thousands of accelerators.
- Maximize compute efficiency through autoscaling and orchestration of production, research, and experimental workloads.
- Build and operate production-grade deployment pipelines for releasing new models reliably.
- Provide high-performance inference infrastructure for next-generation model research.
- Integrate new AI accelerator platforms and support new model architectures, including multi-region deployments and geographic routing.
Requirements
- Significant software engineering experience, particularly with distributed systems.
- Experience with high-performance, large-scale distributed systems and machine learning systems at scale.
- Experience with load balancing, request routing, or traffic management systems.
- Familiarity with LLM inference optimization, batching, and caching strategies.
- Experience with Kubernetes and cloud infrastructure such as AWS, GCP, or Azure.
- Proficiency in Python or Rust; a bachelor's degree or equivalent education, training, or experience.
Nice to have
- Additional experience optimizing inference performance and analyzing observability data from real-world production workloads.
Culture & Benefits
- Collaborative work across research, engineering, policy, and business functions.
- Flexible working hours and office collaboration.
- Generous vacation and parental leave.
- Competitive compensation and benefits, including optional equity donation matching.
- Visa sponsorship is available, although sponsorship cannot be guaranteed for every role or candidate.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Музыка
Осень
Поддержка