Назад
Company hidden
10 часов назад

AI Voice Evaluation Specialist

20 - 25CAD
Формат работы
remote (только USA)
Тип работы
fulltime
Английский
b2
Страна
US/Canada
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
AI Voice Evaluation Specialist (AI/Conversational Systems): Evaluating two AI models through comparable real-time voice conversations with an accent on structured quality assessment, audio analysis, and consistent scenario execution. Focus on identifying error clusters, comparing five evaluation dimensions, and writing evidence-based rationales for model preferences.

Location: Remote in Canada; remote in the US also listed

Salary: 20–25 CAD per hour, based on experience, skills, and qualifications.

Company

hirify.global is a global data engineering company providing data, evaluation frameworks, platforms, services, and human expertise for generative AI builders and adopters.

What you will do

  • Review assigned scenarios and roleplay natural voice conversations with two different AI models.
  • Keep scenarios, conversational approaches, and interaction lengths consistent for fair comparison.
  • Record each interaction and assess model response quality and behavior.
  • Evaluate both models across five defined dimensions and categorize relevant audio or conversation error clusters.
  • Select the stronger model and write a detailed rationale supported by specific observations from both conversations.
  • Apply evaluation guidelines consistently across scenarios and model interactions.

Requirements

  • Bachelor’s degree.
  • Strong attention to detail, listening, comprehension, written communication, critical-thinking, and analytical skills.
  • Ability to explain observations clearly and objectively.
  • Ability to follow detailed evaluation guidelines and compare interactions fairly without personal bias.
  • Comfort speaking naturally and roleplaying different conversational scenarios.
  • Reliability and consistency when completing structured evaluation tasks.
  • Familiarity with AI assistants, voice-based AI, or conversational systems.

Culture & Benefits

  • Three-month, full-time W2 contract.
  • 40 hours per week.
  • Remote work in Canada or the US.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →