Назад
Company hidden
2 дня назад

Lead/Senior Inference Engineer (AI)

127 400 - 236 600$
Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior/lead
Английский
b2
Страна
US/Canada
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead/Senior Inference Engineer (AI): Building and operating the Mariner model-serving platform for Thomson's production LLM traffic with an accent on inference optimization, reliability, observability, and infrastructure sovereignty. Focus on scaling distributed serving systems, reducing cost and latency through batching, caching, and quantization, and establishing production controls for compliance, capacity, and incident response.

Location: Remote within the United States or Canada; listed locations include Eagan, Minnesota; Frisco, Texas; New York, New York; Ann Arbor, Michigan; and Toronto, Ontario. Work from anywhere is available for up to 8 weeks per year.

Base compensation: $127,400–$236,600 USD for eligible US locations; $140,000–$175,000 CAD for Ontario, Canada. The role may also be eligible for an annual bonus.

Company

hirify.global Labs is the research and development division of hirify.global, building AI products and trusted software for legal, tax, accounting, compliance, government, and media professionals.

What you will do

  • Build and operate the model-serving infrastructure supporting production traffic for the Thomson model family and benchmark models.
  • Implement inference optimizations such as batching, caching, and quantization to improve cost, latency, and quality.
  • Improve platform observability and maintain reliability across peak load, scaling, disaster recovery, and new product integrations.
  • Implement ISO 27001 controls and evidence, cost tracking and attribution, and GPU-capacity contingency plans.
  • Work with training and evaluation teams to deploy new model releases and document cost, latency, and reliability tradeoffs.
  • Establish on-call, incident review, onboarding, and engineering practices as an early member of a newly formed team.

Requirements

  • Hands-on infrastructure engineering experience with Kubernetes or a similar platform, including production system ownership.
  • Experience operating model services across peak load, scaling, disaster recovery, and operational excellence.
  • Direct experience with model-serving infrastructure and/or inference optimization for large models.
  • Large-scale distributed systems experience, including production scaling and reliability.
  • Ability to debug distributed systems and production incidents under real traffic.
  • Track record of designing, building, and operating software end to end in production.
  • Ability to champion and enforce engineering best practices while responding to dynamic product requirements.
  • Ability to work autonomously as an early lead engineer and mentor and grow team members.

Nice to have

  • Experience with LLM-serving stacks such as vLLM, TensorRT-LLM, Triton, SGLang, or similar.
  • Exposure to GPU-cluster capacity planning or multi-region and multi-cloud deployment.
  • Experience with regulated or compliance-heavy production environments such as ISO 27001 or SOC 2.
  • Familiarity with systems programming languages such as Rust or Go.
  • Experience with systems-level optimization, including rate limiting, routing, and bottleneck analysis across networking, hardware, and lower-level software.

Culture & Benefits

  • Remote work with flexible workplace policies and work-from-anywhere flexibility for up to 8 weeks annually.
  • Flexible vacation, paid holidays, sick and safe paid time off, two company-wide mental health days, parental leave, and sabbatical leave.
  • Health, dental, vision, disability, life insurance, retirement savings with company match, health and flexible spending accounts, and employee assistance resources.
  • Tuition reimbursement, professional development programs, fitness reimbursement, employee incentive programs, and an employee stock purchase plan.
  • Paid volunteer days and opportunities for pro-bono consulting and environmental, social, and governance initiatives.

Hiring process

  • This is a proactive recruitment posting that may support current or future openings.
  • hirify.global uses AI to support parts of recruitment unless the candidate opts out; a human makes the final consideration decision.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →