Italian Audio Evaluations Specialist (AI Trainer)

TL;DR

Italian Audio Evaluations Specialist (AI Trainer): Designing and executing complex role-play scenarios to evaluate advanced agentic audio models in customer support domains with an accent on audio comprehension, conversational naturalness, and JSON structure validation. Focus on producing high-quality training datasets and auditing model performance to optimize AI accuracy in real-world scenarios.

Location: World Wide - Remote

Salary: $6-to-$65 per hour

Company

hirify.global provides expert-led AI training and evaluation services to optimize advanced agentic models.

What you will do

• Create and execute complex role-play scenarios simulating realistic customer service interactions in travel, finance, and technical support.
• Audit AI model performance across qualitative and quantitative metrics, focusing on task completion and audio comprehension.
• Assess the model's ability to reason about structured data, including JSON structures, functions, and methods.
• Generate diverse, high-quality audio datasets that reflect real customer expectations for clarity and efficiency.

Requirements

• Native or bilingual proficiency in Italian (reading, listening, writing, and speaking).
• Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Basic computer programming literacy, specifically understanding JSON structures and simple logic.
• Access to a high-quality microphone for clean audio input.
• Detail-oriented approach to working with structured prompts and technical guidelines.

Culture & Benefits

• Fully remote work arrangement.
• Flexible freelance / independent contractor engagement.
• Competitive pay based on experience and geographic location.
• Opportunity to contribute to the development of cutting-edge agentic audio models.