Назад
2 дня назад

Software Engineer, Tinker Infrastructure (AI)

300 000 - 400 000$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Software Engineer, Tinker Infrastructure (AI) (Distributed Systems/GPU Infrastructure): Building and operating the distributed systems behind Tinker's fine-tuning platform, including scheduling, resource orchestration, checkpointing, and fault recovery across large GPU clusters with an accent on reliability, throughput, and resilience under partial failure. Focus on designing production infrastructure, leading incident response, improving observability, and evolving systems for concurrent training and sampling workloads.

Location: Onsite in San Francisco, California or New York, New York, United States

Annual salary: $300,000–$400,000 USD

Company

Thinking Machines Lab builds frontier AI models, the Tinker fine-tuning API, and interfaces for human-AI communication.

What you will do

  • Design, build, and operate distributed systems for job scheduling, resource orchestration, checkpointing, and fault recovery across large multi-node GPU clusters.
  • Own reliability, latency, and throughput for live production systems serving concurrent training and sampling workloads.
  • Build graceful degradation and fast recovery for node failures, preemptions, and network partitions without losing user progress or data.
  • Improve platform observability through metrics, tracing, and alerting.
  • Lead incident response, root-cause analysis, and lasting remediation for owned systems.
  • Partner with research and ML infrastructure teams, make architectural tradeoffs, and mentor engineers on distributed systems practices.

Requirements

  • 7+ years of experience building, running, and scaling distributed systems in production, including direct on-call ownership of live services.
  • Deep understanding of consensus, consistency models, failure detection, scheduling, and state management under partial failure.
  • Experience designing reliable systems at scale and diagnosing and resolving production incidents under time pressure.
  • Strong systems-level coding ability in Python, Go, Rust, or C++, with comfort working close to the infrastructure layer.

Nice to have

  • Experience operating large-scale GPU or accelerator clusters, including job orchestration, resource scheduling, or ML training infrastructure.
  • Familiarity with large language model training or inference stacks and the systems demands of fine-tuning or post-training workloads.
  • Experience with checkpointing, distributed storage, or high-throughput networking such as RDMA or NCCL.
  • Experience building developer-facing infrastructure or APIs where reliability and usability are both first-class concerns.
  • Experience driving platform-wide architectural decisions and operating autonomously in a fast-changing environment.

Culture & Benefits

  • Hands-on engineering role with significant ownership and minimal oversight.
  • Health, dental, and vision benefits.
  • Unlimited PTO and paid parental leave.
  • Relocation support as needed.
  • Visa sponsorship is available.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →