Audio Specialist (AI)

TL;DR

Audio Specialist (AI): Benchmarking and assessing advanced agentic audio models for customer support use cases with an accent on role-play evaluation and dataset development. Focus on analyzing model performance based on naturalness, task completion, and technical communication clarity.

Location: Remote (Must be based in the United States)

Salary: $11 - $30.65 per hour

Company

An agency specialized in assessing and optimizing advanced AI audio models for real-world business applications.

What you will do

• Create and execute role-play evaluation scenarios simulating customer service in travel, finance, and telecom domains.
• Contribute to the development of diverse and representative datasets for conversational audio agents.
• Assess model performance using standardized qualitative and quantitative metrics.
• Analyze audio comprehension, response quality, and instruction adherence.
• Evaluate conversational naturalness, including tone, flow, and coherence.

Requirements

• Must be based in the United States.
• English: Fluent proficiency across all skills (C1+).
• Basic programming literacy, including understanding of JSON structures, functions, and methods.
• Ability to reason about structured data and simple logic.
• Possession of a high-quality microphone and a secure computer.
• Strong verbal communication skills for simulated support contexts.

Culture & Benefits

• Fully remote project-based work.
• Hourly pay scale determined by expertise and geographic location.
• Flexible contractor arrangement.