Назад
Company hidden
24 дня назад

ML Infrastructure Engineer - New Grad (AI)

131 200 - 196 800$
Формат работы
onsite
Тип работы
fulltime
Грейд
junior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
ML Infrastructure Engineer - New Grad (AI): Building and operating production inference serving features for SambaNova's RDU accelerators with an accent on Python, vLLM integration, public APIs, and inference accuracy. Focus on implementing speculative decoding, prompt caching, tool calling, and long-context inference while debugging latency, throughput, and reliability issues.

Location: Austin, Texas, United States, or San Jose, California, United States

Base salary: $131,200–$196,800 USD per year

Company

hirify.global develops next-generation AI infrastructure, including a full-stack inference platform based on Reconfigurable Dataflow Units (RDUs) and SambaRack rack-scale hardware.

What you will do

  • Implement inference features on RDU accelerators, including speculative decoding, constrained decoding, tool calling, prompt caching, and long-context inference.
  • Adapt vLLM and related serving frameworks to the RDU architecture.
  • Build and maintain endpoints for the public inference API.
  • Write accuracy verification and regression tests for inference features.
  • Debug latency, throughput, and reliability issues in production services.

Requirements

  • B.S. in Computer Science, Electrical Engineering, or a related field.
  • Strong programming skills in Python.
  • Understanding of algorithms, data structures, concurrency, and systems design.
  • Coursework or project experience in distributed systems or machine learning.
  • Experience with LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM.
  • Experience with inference techniques such as speculative decoding, KV caching, or continuous batching.
  • Experience with PyTorch.

Nice to have

  • M.S. or Ph.D. in Computer Science, Electrical Engineering, or a related field.
  • Experience building or maintaining APIs or backend services.
  • Internship or research experience in ML systems or backend infrastructure.
  • Experience with disaggregated systems, including prefill and decode.
  • Open source project ownership or contributions.

Culture & Benefits

  • Full-time US employment with equity and benefits.
  • Medical insurance with 95% premium coverage for employees and 77% coverage for dependents.
  • Health Savings Account with employer contribution, plus dental, vision, disability, life, AD&D, and Flexible Spending Account options.
  • Well-being benefits include Headspace, Gympass+, One Medical, and counseling through an Employee Assistance Program.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →