Чёткая роль в одной из ведущих AI-компаний с ответственностью за ключевую инфраструктуру токенизации на всех этапах работы с моделями; главный ограничивающий фактор - привязка к Парижу или Лондону.
?Привязка к месту
На переднем крае AI
Ключевая ответственность
Современный стек
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Research Engineer - Tokenizer & Protocols (AI): Building and maintaining core tokenization libraries, model interfaces, and shared tooling across pretraining, post-training, and deployment with an accent on tokenizer algorithms, formats, and production-grade software. Focus on evolving tokenizers for changing models and use cases, ensuring correctness across training, evaluation, and production, and supporting LLM serving.
Location: Primarily based in European offices in Paris or London; remote candidates may be considered only from France or the UK. New hires must attend the local office for the first onboarding week and at least 4 days per month afterward. Candidates should reside in or be open to relocating to these locations.
Company
Mistral AI provides full-stack AI solutions spanning frontier models, developer tools, applications, and compute for high-stakes industries and the public sector.
What you will do
Design, build, and maintain core libraries for tokenization and model interfaces.
Evolve formats and tokenizers as models and use cases change.
Build robust shared tooling from research requirements.
Support consistency across pretraining, post-training, evaluation, and deployment.
Requirements
Strong software engineering background with excellent Python skills.
Excellent knowledge of tokenizers, including BPE and other tokenization algorithms, special tokens, chat templates, and tokenizer training.
Experience building production-grade libraries used by many people.
Good knowledge of how LLMs are trained and served.
Strong attention to correctness and detail.
Clear communication and a collaborative, low-ego mindset.
Nice to have
Hands-on experience with tiktoken or Hugging Face tokenizers.
Open-source maintenance experience.
Experience with inference engines.
Culture & Benefits
Collaborative, creative, low-ego, and team-oriented environment.
Benefits may include healthcare, parental leave, retirement plans, relocation support, wellness programs, and meal and transportation allowances, depending on country.
Travel and accommodation for the first onboarding week are covered for eligible remote hires.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →