Назад
Company hidden
4 часа назад

Senior AI Systems Engineer (Inference)

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior AI Systems Engineer (Inference): Building and scaling large-scale model inference systems with an accent on GPU fleet management, Kubernetes orchestration, and deployment pipelines. Focus on optimizing model efficiency, integrating new architectures, and ensuring high reliability for multimodal AI services.

Location: Redwood City, CA (Hybrid)

Company

hirify.global is building unified general intelligence capable of generating, understanding, and operating in the physical world through multimodal AI.

What you will do

  • Integrate new model architectures into the inference engine.
  • Scale deployments across thousands of machines and optimize GPU utilization.
  • Build internal tooling to measure, profile, and track inference jobs.
  • Automate, test, and maintain inference services for maximum uptime.
  • Collaborate with research and infrastructure teams to optimize model efficiency.
  • Develop scheduling systems to manage workloads across clusters and hardware providers.

Requirements

  • Strong Python and system-architecture skills.
  • Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, or TensorRT-LLM.
  • Experience with queues, scheduling, traffic control, and fleet management at scale.
  • Proficiency with Linux, Docker, and Kubernetes.
  • Familiarity with Redis and S3-compatible storage.
  • Must be able to work in a hybrid capacity in Redwood City, CA.

Nice to have

  • Experience with modern networking stacks including RDMA (RoCE, InfiniBand, NVLink).
  • Background in high-performance large-scale ML systems (100+ GPUs).
  • Knowledge of CUDA, FFmpeg, or multimedia processing.

Culture & Benefits

  • Opportunity to work on cutting-edge multimodal AI and general intelligence.
  • Collaborative environment spanning research, engineering, and infrastructure.
  • Focus on high-scale systems and complex infrastructure challenges.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →