Назад
9 дней назад

Research Engineer - Tokenizer & Protocols (AI)

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
France/UK
Релокация
France/UK
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Research Engineer - Tokenizer & Protocols (AI): Building and maintaining core tokenization libraries, model interfaces, and shared tooling across pretraining, post-training, and deployment with an accent on tokenizer algorithms, formats, and production-grade software. Focus on evolving tokenizers for changing models and use cases, ensuring correctness across training, evaluation, and production, and supporting LLM serving.

Location: Primarily based in European offices in Paris or London; remote candidates may be considered only from France or the UK. New hires must attend the local office for the first onboarding week and at least 4 days per month afterward. Candidates should reside in or be open to relocating to these locations.

Company

Mistral AI provides full-stack AI solutions spanning frontier models, developer tools, applications, and compute for high-stakes industries and the public sector.

What you will do

  • Design, build, and maintain core libraries for tokenization and model interfaces.
  • Evolve formats and tokenizers as models and use cases change.
  • Build robust shared tooling from research requirements.
  • Support consistency across pretraining, post-training, evaluation, and deployment.

Requirements

  • Strong software engineering background with excellent Python skills.
  • Excellent knowledge of tokenizers, including BPE and other tokenization algorithms, special tokens, chat templates, and tokenizer training.
  • Experience building production-grade libraries used by many people.
  • Good knowledge of how LLMs are trained and served.
  • Strong attention to correctness and detail.
  • Clear communication and a collaborative, low-ego mindset.

Nice to have

  • Hands-on experience with tiktoken or Hugging Face tokenizers.
  • Open-source maintenance experience.
  • Experience with inference engines.

Culture & Benefits

  • Collaborative, creative, low-ego, and team-oriented environment.
  • Benefits may include healthcare, parental leave, retirement plans, relocation support, wellness programs, and meal and transportation allowances, depending on country.
  • Travel and accommodation for the first onboarding week are covered for eligible remote hires.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →