Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
развернуть
$131к-197к/год
$130к$150кмедиана$170к
По похожим ролям (6) ~ $150к/год
91
Крутая вакансия
развернуть
Чётко очерченная стартовая роль даёт возможность работать с продакшен-инфраструктурой для LLM в AI-продуктовой компании, с сильной технической составляющей и хорошим набором льгот.
Передовой AI-стек
Понятные задачи
Сфера искусственного интеллекта
Хорошие льготы
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
ML Infrastructure Engineer - New Grad (AI): Building and operating production inference serving features for SambaNova's RDU accelerators with an accent on Python, vLLM integration, public APIs, and inference accuracy. Focus on implementing speculative decoding, prompt caching, tool calling, and long-context inference while debugging latency, throughput, and reliability issues.
Location: Austin, Texas, United States, or San Jose, California, United States
Base salary: $131,200–$196,800 USD per year
Company
hirify.global develops next-generation AI infrastructure, including a full-stack inference platform based on Reconfigurable Dataflow Units (RDUs) and SambaRack rack-scale hardware.
What you will do
Implement inference features on RDU accelerators, including speculative decoding, constrained decoding, tool calling, prompt caching, and long-context inference.
Adapt vLLM and related serving frameworks to the RDU architecture.
Build and maintain endpoints for the public inference API.
Write accuracy verification and regression tests for inference features.
Debug latency, throughput, and reliability issues in production services.
Requirements
B.S. in Computer Science, Electrical Engineering, or a related field.
Strong programming skills in Python.
Understanding of algorithms, data structures, concurrency, and systems design.
Coursework or project experience in distributed systems or machine learning.
Experience with LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM.
Experience with inference techniques such as speculative decoding, KV caching, or continuous batching.
Experience with PyTorch.
Nice to have
M.S. or Ph.D. in Computer Science, Electrical Engineering, or a related field.
Experience building or maintaining APIs or backend services.
Internship or research experience in ML systems or backend infrastructure.
Experience with disaggregated systems, including prefill and decode.
Open source project ownership or contributions.
Culture & Benefits
Full-time US employment with equity and benefits.
Medical insurance with 95% premium coverage for employees and 77% coverage for dependents.
Health Savings Account with employer contribution, plus dental, vision, disability, life, AD&D, and Flexible Spending Account options.
Well-being benefits include Headspace, Gympass+, One Medical, and counseling through an Employee Assistance Program.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →