Назад
Company hidden
обновлено 2 месяца назад

Head of AI Data Labeling (AI)

Формат работы
hybrid
Тип работы
fulltime
Грейд
head
Английский
b2
Страна
France/UK
Релокация
France
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Head of AI Data Labeling (AI): Building and leading the data annotation team to support AI safety and model training with an accent on evaluation frameworks, quality assurance, and RLHF workflows. Focus on scaling annotation operations, managing distributed teams, and translating research objectives into high-quality training data for LLMs.

Location: Hybrid, Paris or London. Relocation support is available for moving to Paris after the probationary period.

Company

hirify.global is an AI Safety company building a safety, reliability, and optimization layer for AI systems through natural-language policies, automated testing, enforcement, and continuous improvement.

What you will do

  • Build and lead the Data Labeling team, including hiring, coaching, and performance management.
  • Define annotation guidelines, quality standards, evaluation frameworks, calibration sessions, and auditing systems.
  • Translate research objectives into labeling workflows in partnership with AI researchers and engineers.
  • Prioritize labeling projects and monitor quality, consistency, throughput, and cost.
  • Lead AI evaluation projects covering safety evaluations, preference ranking, RLHF, policy evaluation, and benchmark creation.
  • Improve annotation tooling, workflow automation, vendor operations, reporting dashboards, and distributed-team quality.

Requirements

  • Experience leading data annotation or AI evaluation teams.
  • Strong operational and people management skills with the ability to design scalable processes without sacrificing quality.
  • Understanding of AI model evaluation, LLM behavior, and modern annotation workflows.
  • Clear communication across technical and non-technical teams, with the ability to work in a fast-moving startup environment.
  • English is required for the application and role communication.
  • The role may involve offensive, harmful, violent, sexual, or otherwise disturbing content.

Nice to have

  • Experience managing annotation programs for LLMs, generative AI, or machine learning.
  • Experience with RLHF, preference data collection, safety evaluations, benchmark creation, Trust & Safety, AI Safety, Content Moderation, or ML Ops.
  • Experience managing distributed or global annotation teams, vendors, or outsourcing operations.
  • Familiarity with prompt engineering, AI safety policies, SQL, Python, data analysis, or annotation-platform automation.
  • Background in linguistics, cognitive science, machine learning, or data operations.

Culture & Benefits

  • Flexible hybrid work from Paris or London, with a spacious Paris office.
  • Competitive compensation including equity and flexible time off.
  • Premium private health insurance and mental health support, including therapy coverage.
  • Language lessons, learning and development support, and required hardware and software.
  • Lunch and dinner are covered when working from the office.
  • Team off-sites are held twice a year.

Hiring process

  • 25-minute introductory call.
  • Take-home test assignment.
  • 45-minute final conversation with the CEO.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →