Labeler / Annotator (AI Trainer)

TL;DR

Labeler / Annotator (AI Trainer): Evaluating and analyzing AI-generated responses in French using side-by-side (SBS) comparisons with an accent on accuracy, relevance, and cultural nuance. Focus on improving AI communication and instruction-following through structured evaluation frameworks.

Location: Remote (LATAM)

Salary: COP 7,506,000 – 8,541,000 monthly

Company

A technology solutions firm headquartered in the US with a strong presence and expanding footprint across Latin America.

What you will do

• Perform side-by-side (SBS) comparisons of AI-generated responses across various scenarios.
• Evaluate outputs based on accuracy, relevance, clarity, and instruction-following.
• Identify nuances in tone, meaning, and cultural context within the French language.
• Apply detailed, scenario-specific annotation guidelines to maintain high-quality evaluations.
• Analyze a wide range of tasks, including general Q&A, web search results, and multi-turn conversations.

Requirements

• Native or professional fluency in French.
• Strong English reading comprehension for understanding guidelines.
• Prior experience with side-by-side (SBS) labeling or annotation.
• Excellent analytical thinking and high attention to detail.
• Ability to quickly understand and apply structured evaluation frameworks.

Nice to have

• Background in linguistics, translation, or localization.
• Experience in AI evaluation, data annotation, or search relevance analysis.

Culture & Benefits

• Opportunity to work on cutting-edge AI systems and build transferable AI evaluation skills.
• Collaborative environment within a global, multilingual team.
• Employment via an Employer of Record (EOR) partner for full local labor law compliance.
• Locally compliant benefits, including social security and healthcare contributions (e.g., IMSS).
• Statutory benefits such as paid vacation, aguinaldo, and vacation premiums.