3 дня назад
AI Voice Evaluation Specialist
20 - 25$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AI Voice Evaluation Specialist (AI/Voice Evaluation): Evaluating two AI models through consistent real-time voice conversations with an accent on conversational quality, structured scoring, and error identification. Focus on comparing model behavior fairly, maintaining consistent scenarios and turn counts, and writing evidence-based rationales for the final model selection.
Location: Remote - United States
Salary: $20–$25 per hour, based on experience, skills, and qualifications.
Company
is a global data engineering company providing data, evaluation frameworks, platforms, and human expertise for generative AI builders and adopters.
What you will do
- Review assigned scenarios and roleplay natural voice conversations with two AI models.
- Keep scenarios, conversational approaches, and turn counts consistent between Model A and Model B.
- Record each interaction and evaluate model responses across five defined dimensions.
- Identify and categorize audio and conversational error clusters.
- Compare both models and select the stronger overall conversational experience.
- Write detailed, evidence-based rationales and apply evaluation guidelines consistently.
Requirements
- Bachelor's degree.
- Strong attention to detail, listening, comprehension, critical-thinking, and analytical skills.
- Strong written communication and the ability to explain observations clearly and objectively.
- Ability to follow detailed evaluation guidelines and compare interactions without personal bias.
- Comfort speaking naturally and role-playing different conversational scenarios.
- Familiarity with AI assistants, voice-based AI, or conversational systems.
Culture & Benefits
- Three-month, full-time W-2 contract.
- 40 hours per week.
- Remote work from the United States.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →