Welsh Audio Specialist (AI Trainer)

TL;DR

Welsh Audio Specialist (AI Trainer): Designing and executing evaluation frameworks for advanced agentic audio models with an accent on conversational naturalness and task accuracy. Focus on creating realistic customer support scenarios, auditing model outputs, and generating high-quality audio datasets.

Location: World Wide - Remote

Salary: $6 - $65 per hour

Company

An AI agency specializing in producing robust, expert-crafted training data to optimize the performance of advanced agentic audio models.

What you will do

• Create and execute complex, role-play-based evaluation scenarios simulating customer service in travel, finance, and tech support.
• Audit AI model performance using qualitative and quantitative metrics for task completion and audio comprehension.
• Evaluate the model's basic programming literacy, specifically its ability to reason about JSON structures and functions.
• Develop diverse, high-quality audio datasets reflecting real-world customer expectations for clarity and efficiency.

Requirements

• Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual proficiency in Welsh.
• Basic computer programming literacy, specifically comfortable understanding of JSON structures and simple logic.
• Access to a high-quality microphone for clean audio input during evaluations.
• Meticulous approach to working with structured prompts and complex evaluation rubrics.

Culture & Benefits

• Fully remote, freelance engagement as an independent contractor.
• Pay rate determined by experience, expertise, and geographic location.
• Opportunity to contribute to cutting-edge AI benchmark projects and model optimization.