Portuguese Audio Evaluations Specialist (AI)

TL;DR

Portuguese Audio Evaluations Specialist (AI Trainer): Designing and executing evaluation frameworks for agentic audio models with an accent on role-play scenarios and conversational accuracy. Focus on auditing model performance, assessing technical literacy in JSON, and generating high-quality audio datasets.

Location: Remote (World Wide)

Salary: $6 - $65 per hour

Company

hirify.global specializes in producing high-quality training data and expert evaluations to optimize the performance of advanced AI models.

What you will do

• Create and execute complex role-play scenarios simulating realistic customer service interactions in travel, finance, and technical support.
• Audit AI model performance using qualitative and quantitative metrics, focusing on task accuracy and conversational naturalness.
• Evaluate the model's technical literacy, specifically its ability to reason about JSON structures, functions, and methods.
• Generate diverse, high-quality audio datasets that reflect real-world customer expectations for clarity and efficiency.

Requirements

• Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual proficiency in Portuguese (reading, listening, writing, and speaking).
• Basic computer programming literacy, including a comfortable understanding of JSON and simple logic.
• Meticulous approach to working with structured prompts and complex evaluation rubrics.
• Access to a high-quality microphone to ensure clean audio input during evaluations.

Culture & Benefits

• Freelance / Independent Contractor engagement.
• Fully remote work environment with a global reach.
• Competitive hourly pay determined by experience, expertise, and geographic location.