3 дня назад
Multilingual Audio Evaluator (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Multilingual Audio Evaluator (AI): Evaluating conversational AI agents through live multilingual roleplay sessions, recordings, transcript labeling, and structured scoring with an accent on spoken-language quality, technical logging, and JSON validation. Focus on conducting real-time evaluations, troubleshooting structural data issues, and writing evidence-based feedback to improve AI conversation reliability.
Location: Remote, available in Argentina, Brazil, France, Germany, Italy, the Netherlands, Portugal, and Spain; subject to project location restrictions
Compensation: To be confirmed
Company
creates training and evaluation data for frontier AI models.
What you will do
- Prepare and confirm tools and access before live evaluation sessions.
- Conduct real-time roleplay scenarios with conversational AI agents.
- Capture recordings, session IDs, and tool-call or console logs.
- Label conversation transcripts and score interactions using structured rubrics.
- Write clear explanations supporting evaluation scores.
- Read, validate, and troubleshoot JSON, including structural and formatting issues.
Requirements
- C1/C2 spoken fluency in at least one target language: Welsh, Dutch, Greek, Italian, French, German, or Portuguese.
- Ability to demonstrate language proficiency through a speaking and listening assessment.
- Strong JSON reading, validation, and troubleshooting skills.
- Comfort using digital tools and collecting recordings and technical logs.
- Strong attention to detail, consistent guideline adherence, clear written communication, and sound judgment.
Nice to have
- Experience in AI evaluation, audio annotation, or transcript labeling.
- Background in technical support, quality assurance, or software development.
- Familiarity with conversational AI, APIs, and structured data.
Culture & Benefits
- Remote project-based work.
- Project duration of approximately 2–3 months.
- Project start date: October 9, 2026.
- Commitment and compensation to be confirmed.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →