Назад
Company hidden
9 дней назад

Customer Reliability Engineer (AI Infrastructure)

Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
middle
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Customer Reliability Engineer (AI Infrastructure): Supporting large AI training and inference workloads on GPU clusters with an accent on Linux and Kubernetes troubleshooting, incident response, and provider coordination. Focus on diagnosing complex cluster and GPU failures, building monitoring and automation tooling, and improving reliability through runbooks and preventative fixes.

Location: Remote

Company

hirify.global is building a market and infrastructure platform for buying, selling, operating, and financing compute capacity for AI workloads.

What you will do

  • Own customer issues from reproduction and diagnosis through resolution, escalation, and follow-up.
  • Debug Linux systems, including processes, networking, storage, kernel logs, resource contention, systemd, and journald.
  • Investigate Kubernetes failures involving pods, nodes, scheduling, resource limits, and crash loops.
  • Respond to customer-impacting incidents in a 24/7 on-call rotation and provide clear status updates.
  • Coordinate with compute providers to identify responsibility, resolve issues, and track recurring failures.
  • Build Python or Bash automation, cluster and node monitoring, GPU telemetry, dashboards, alerts, runbooks, and customer documentation.

Requirements

  • Practical Linux troubleshooting experience from the command line.
  • Working knowledge of Kubernetes, including pods, nodes, deployments, services, scheduling, and failure investigation.
  • Ability to write automation scripts in Python or Bash.
  • Strong technical writing and the ability to explain complex issues clearly to customers.
  • Good judgment during incidents, including prioritization, escalation, and communication under pressure.
  • Willingness to participate in a 24/7 on-call rotation.

Nice to have

  • Production experience with NVIDIA GPUs, drivers, CUDA, DCGM, or the Kubernetes device plugin.
  • Experience with InfiniBand, RoCE, NCCL, HPC, or Slurm.
  • Previous customer-facing technical experience in support engineering, technical account management, solutions, or professional services.
  • Knowledge of Prometheus, Grafana, Datadog, Terraform, Ansible, or Helm.
  • Interest in AI infrastructure and large-scale training workloads.

Culture & Benefits

  • High-growth environment focused on AI infrastructure.
  • Competitive compensation with meaningful equity.
  • Healthcare, dental, and vision coverage for employees and dependents.
  • 401(k) and unlimited PTO.
  • Inclusive and equal-opportunity workplace.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →