German Audio Evaluations Specialist (AI Trainer)

TL;DR

German Audio Evaluations Specialist (AI Trainer): Designing and executing complex role-play scenarios to evaluate agentic audio models for customer support domains with an accent on conversational naturalness and audio comprehension. Focus on auditing model performance, generating high-quality audio datasets, and assessing technical literacy in JSON and structured data.

Location: Remote (World Wide)

Salary: $6–$65 per hour

Company

AI benchmark evaluation agency focused on optimizing advanced agentic audio models for real-world customer support scenarios.

What you will do

• Create and execute role-play scenarios simulating customer service interactions in travel, finance, and telecom domains.
• Audit AI model performance using qualitative and quantitative metrics, focusing on task accuracy and conversational naturalness.
• Assess the model's basic computer programming literacy, including understanding of JSON structures, functions, and methods.
• Contribute to the development of high-quality audio datasets that reflect real customer expectations.

Requirements

• Native or bilingual proficiency in German (reading, listening, writing, and speaking).
• Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Basic computer programming literacy, specifically understanding JSON structures and simple logic.
• Access to a high-quality microphone to ensure clean audio input.
• Meticulous approach to working with structured prompts and complex evaluation rubrics.

Culture & Benefits

• Freelance / Independent Contractor engagement.
• Fully remote work environment.
• Competitive hourly pay based on experience, expertise, and geographic location.