Labeler / Annotator – AI Response Evaluation (Korean) (AI)

TL;DR

Labeler / Annotator – AI Response Evaluation (Korean) (AI): Evaluating and comparing AI-generated responses in Korean with an accent on accuracy, relevance, and cultural nuance. Focus on performing side-by-side (SBS) evaluations across various scenarios including Q&A and multi-turn conversations.

Location: Remote (Argentina)

Salary: ARS 2,400,000 – 2,720,000 per month

Company

A technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States and Latin America.

What you will do

• Perform side-by-side (SBS) comparisons of AI-generated responses.
• Evaluate outputs based on accuracy, relevance, clarity, and instruction-following.
• Identify nuances in tone, meaning, and cultural context in the Korean language.
• Apply detailed, scenario-specific annotation guidelines.
• Evaluate AI responses across general Q&A, web search, file-based, and image-based tasks.

Requirements

• Native or professional fluency in Korean.
• Strong English reading comprehension for understanding guidelines.
• Prior experience with side-by-side (SBS) labeling or annotation.
• Excellent analytical thinking and attention to detail.
• Must be based in Argentina (implied by ARS currency and local benefit structure).

Nice to have

• Background in linguistics, translation, or localization.
• Experience in AI evaluation, data annotation, or search relevance analysis.

Culture & Benefits

• Competitive compensation aligned with local markets.
• Locally compliant benefits including paid vacation and aguinaldo (SAC).
• Social security contributions and healthcare coverage (Obra Social).
• Opportunity to work on cutting-edge AI systems within a global, multilingual team.

Hiring process

• Structured onboarding program including training sessions and practice exercises.
• Calibration against quality benchmarks.
• Final qualification review before moving into production work.