Castilian Spanish Labeler / Annotator (AI)

TL;DR

Castilian Spanish Labeler / Annotator (AI): Evaluating and analyzing AI-generated responses to improve language understanding and communication in Castilian Spanish with an accent on accuracy, cultural nuance, and instruction-following. Focus on performing side-by-side model comparisons, identifying linguistic subtleties, and applying structured annotation frameworks.

Location: Remote within the United States. Candidates must be authorized to work in the US and reside within a U.S. time zone.

Salary: $38.46 - $40.87 per hour

Company

A technology solutions firm that connects strategy and execution across AI, cloud, data, and product development to help organizations solve complex challenges.

What you will do

• Perform side-by-side comparisons of AI-generated responses for quality assessment.
• Evaluate outputs for accuracy, relevance, clarity, and strict instruction-following.
• Identify linguistic nuances, tone, and cultural context specific to Spanish as used in Spain.
• Apply detailed, scenario-specific annotation guidelines consistently.
• Document evaluation decisions and provide clear rationales for quality reviews.
• Participate in calibration and ongoing training activities to maintain quality standards.

Requirements

• Native-level or professional fluency in Castilian Spanish (Spain).
• Must be authorized to work in the United States and reside in a U.S. time zone.
• Strong English reading comprehension to understand detailed technical guidelines.
• Prior experience with side-by-side labeling, annotation, or comparative content evaluation.
• Excellent analytical thinking and high attention to detail.
• Ability to explain evaluation decisions clearly in writing.

Nice to have

• Experience with AI response evaluation or model-quality assessment.
• Experience with data labeling or annotation.
• Experience evaluating search relevance or user-facing digital experiences.

Culture & Benefits

• Medical, dental, and vision coverage.
• 401(k) retirement plan and Flexible Spending Account (FSA).
• Competitive paid time off and parental leave.
• Opportunities for professional growth and development.
• Flexible work hours within local time zone after the initial training period.