Назад
Company hidden
3 дня назад

AI Voice Evaluation Specialist

20 - 25$
Формат работы
remote (только USA)
Тип работы
project
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
AI Voice Evaluation Specialist (AI/Voice Evaluation): Evaluating two AI models through consistent real-time voice conversations with an accent on conversational quality, structured scoring, and error identification. Focus on comparing model behavior fairly, maintaining consistent scenarios and turn counts, and writing evidence-based rationales for the final model selection.

Location: Remote - United States

Salary: $20–$25 per hour, based on experience, skills, and qualifications.

Company

hirify.global is a global data engineering company providing data, evaluation frameworks, platforms, and human expertise for generative AI builders and adopters.

What you will do

  • Review assigned scenarios and roleplay natural voice conversations with two AI models.
  • Keep scenarios, conversational approaches, and turn counts consistent between Model A and Model B.
  • Record each interaction and evaluate model responses across five defined dimensions.
  • Identify and categorize audio and conversational error clusters.
  • Compare both models and select the stronger overall conversational experience.
  • Write detailed, evidence-based rationales and apply evaluation guidelines consistently.

Requirements

  • Bachelor's degree.
  • Strong attention to detail, listening, comprehension, critical-thinking, and analytical skills.
  • Strong written communication and the ability to explain observations clearly and objectively.
  • Ability to follow detailed evaluation guidelines and compare interactions without personal bias.
  • Comfort speaking naturally and role-playing different conversational scenarios.
  • Familiarity with AI assistants, voice-based AI, or conversational systems.

Culture & Benefits

  • Three-month, full-time W-2 contract.
  • 40 hours per week.
  • Remote work from the United States.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →