Назад
Company hidden
2 дня назад

Director, Model Inference Engineering (AI)

Формат работы
hybrid
Тип работы
fulltime
Грейд
director
Английский
b2
Страна
UK/Switzerland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Director, Model Inference Engineering (AI): Building and operating Mariner, a production model-serving platform for Thomson's model family and benchmark models with an accent on inference optimization, reliability, observability, and cost control. Focus on scaling distributed serving infrastructure, implementing compliance and capacity controls, and deploying new model releases across international product integrations.

Location: Hybrid role based in Zug, Switzerland, with another location in London, United Kingdom.

Company

hirify.global Labs is the research and development division of hirify.global, building state-of-the-art AI products and custom models for regulated professional workflows.

What you will do

  • Build and operate Mariner, the model-serving infrastructure supporting production traffic for Thomson's model family and benchmark models.
  • Implement inference optimization techniques such as batching, caching, and quantization to improve cost and latency without sacrificing quality.
  • Improve observability, reliability, disaster recovery, and operational readiness as call volume and deployment coverage grow.
  • Implement ISO 27001 compliance controls and evidence, cost tracking and attribution, and GPU-capacity contingency plans.
  • Document cost, latency, and reliability tradeoffs and collaborate with training, evaluation, research, product, and engineering stakeholders to deploy new model releases.
  • Establish team practices and tooling, including on-call, incident reviews, and onboarding, while mentoring and developing team members.

Requirements

  • Hands-on infrastructure engineering experience with Kubernetes or a similar technology, including ownership of production systems.
  • Experience operating model services across peak load, scaling, disaster recovery, and operational excellence scenarios.
  • Direct experience with model-serving infrastructure or inference optimization for large models.
  • Large-scale distributed systems experience, including production scaling and reliability.
  • Ability to debug distributed systems and production incidents under real traffic.
  • Track record of designing, building, and operating software end to end in production.
  • Ability to champion and enforce engineering best practices while working with changing product requirements.
  • Ability to operate autonomously as an early lead engineer and mentor and grow team members.

Nice to have

  • Experience with LLM-serving stacks such as vLLM, TensorRT-LLM, Triton, or SGLang.
  • Experience with GPU-cluster capacity planning or multi-region and multi-cloud deployments.
  • Experience in regulated or compliance-heavy production environments, including ISO 27001 or SOC 2.
  • Familiarity with systems development languages such as Rust or Go.
  • Experience with systems-level optimization, rate limiting, routing, and bottleneck analysis across networking, hardware, and lower-level software.

Culture & Benefits

  • Flexible hybrid work model for office-based roles.
  • Work from anywhere for up to 8 weeks per year, alongside flexible work-life balance policies.
  • Flexible vacation, two company-wide mental health days, retirement savings, tuition reimbursement, incentive programs, and wellbeing resources.
  • Continuous learning and career development through Grow My Way programming and skills-first development.
  • Two paid volunteer days annually and opportunities for pro-bono consulting and ESG initiatives.
  • Collaborative, inclusive culture focused on customer impact, rapid learning, integrity, and trusted information.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →