Labeler / Annotator (AI)

TL;DR

Labeler / Annotator (AI): Evaluating and comparing AI-generated responses to improve model accuracy, relevance, and cultural nuance in Japanese with an accent on side-by-side (SBS) evaluation. Focus on identifying linguistic nuances, following complex annotation guidelines, and ensuring high-quality data for AI training.

Location: Remote (Must be based in Mexico)

Salary: MXN $40,800 – $46,400 per month

Company

hirify.global is a technology solutions firm headquartered in Bellevue, Washington, with a presence in the United States and Latin America.

What you will do

• Perform side-by-side (SBS) comparisons of AI-generated responses for accuracy, relevance, and clarity.
• Evaluate outputs across various scenarios, including general Q&A, web search, and image generation.
• Identify nuances in tone, meaning, and cultural context specific to the Japanese language.
• Apply detailed, scenario-specific annotation guidelines to ensure high-quality data.
• Maintain consistency in evaluating single-turn and multi-turn conversations.

Requirements

• Native or professional fluency in Japanese.
• Strong English reading comprehension for understanding guidelines.
• Prior experience with side-by-side (SBS) labeling or annotation.
• Excellent analytical thinking and attention to detail.
• Must be based in Mexico to be eligible for local EOR employment and benefits (IMSS, aguinaldo).

Nice to have

• Background in linguistics, translation, or localization.
• Experience in AI evaluation, data annotation, or search relevance analysis.

Culture & Benefits

• Opportunity to work on cutting-edge AI systems within a global, multilingual team.
• Locally compliant employment through an EOR partner.
• Statutory benefits including paid vacation, aguinaldo, and vacation premium.
• Social security and healthcare contributions (IMSS).
• Structured onboarding program with training and calibration sessions.