Italian Audio Evaluations Specialist (AI)

Location: Worldwide remote

Salary: $6–$65 per hour, with the final rate based on experience, expertise, and geographic location.

Company

hirify.global is sourcing independent specialists for an AI benchmark evaluation project focused on agentic audio models.

What you will do

• Create and execute complex role-play scenarios simulating customer support interactions in travel, finance, telecommunications, and technical support.
• Audit AI model performance using qualitative and quantitative metrics for task completion, conversational naturalness, and audio comprehension.
• Evaluate basic programming literacy, including JSON structures, functions, methods, and structured-data reasoning.
• Generate diverse, high-quality audio datasets that reflect realistic customer expectations.
• Work autonomously with structured prompts, evaluation rubrics, and technical guidelines.

Requirements

• Italian: native or bilingual proficiency across reading, listening, writing, and speaking.
• Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Strong analytical and verbal communication skills for simulated customer-support role-plays.
• Basic computer programming literacy, including JSON, functions, methods, and simple logic.
• Meticulous attention to detail when working with structured prompts and evaluation rubrics.
• Required equipment: a high-quality microphone, secure computer, and high-speed internet.

Culture & Benefits

• Freelance independent-contractor engagement.
• Remote work from anywhere in the world.
• Work is organized around autonomous project deliverables.
• Company-sponsored health insurance and paid time off are not provided.