Назад
Company hidden
6 часов назад

Software Engineer (AI Inference & RL Systems)

225 000 - 550 000$
Формат работы
onsite
Тип работы
fulltime
Английский
b2
Страна
US
Релокация
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Software Engineer (AI Inference & RL Systems): Designing and operating distributed systems for production model inference and large-scale reinforcement learning and post-training workflows with an accent on long-context execution, GPU constraints, and system reliability. Focus on optimizing KV-cache management, batching, scheduling, performance bottlenecks, and fault recovery across serving, networking, storage, and RL pipelines.

Location: San Francisco, United States; on-site

Salary: $225,000–$550,000 annual salary, plus significant equity.

Company

hirify.global builds safe artificial general intelligence through frontier-scale pre-training, domain-specific reinforcement learning, long-context models, and inference-time compute.

What you will do

  • Design and scale high-performance inference serving systems for production models.
  • Optimize KV-cache management, batching strategies, scheduling, latency, and throughput for long-context workloads.
  • Build and maintain distributed reinforcement learning and post-training infrastructure.
  • Improve the reliability of rollout, evaluation, and reward pipelines.
  • Automate fault detection and recovery across serving and RL systems.
  • Profile and eliminate bottlenecks across GPU, networking, and storage layers while collaborating with Kernel and Research teams.

Requirements

  • Strong software engineering and distributed systems fundamentals.
  • Experience building or operating large-scale inference or training systems.
  • Deep understanding of GPU execution constraints and memory trade-offs.
  • Experience debugging performance issues in production machine learning systems.
  • Ability to evaluate trade-offs between latency, throughput, and cost.
  • Track record of owning critical production infrastructure.

Culture & Benefits

  • Small, fast-paced, highly focused team working toward safe AGI.
  • Integrity, hands-on ownership, teamwork, focus, and quality are core values.
  • 401(k) plan with 6% salary matching.
  • Health, dental, and vision insurance for employees and dependents.
  • Unlimited paid time off.
  • Visa sponsorship and relocation stipend to bring candidates to San Francisco, if possible.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →