AI Response Labeler / Annotator (Castilian Spanish)

Location: Remote within the United States. Candidates must be authorized to work in the United States and reside within a U.S. time zone. During the approximately 30-day training and qualification period, work hours are 9:00 a.m. to 5:00 p.m. Pacific Time; afterward, standard business hours may be worked in the local time zone.

Compensation: $38.46–$40.87 USD per hour, with a midpoint of $39.66 per hour.

Company

hirify.global is a technology solutions firm connecting strategy and execution across AI, cloud, data, product development, and emerging technology.

What you will do

• Compare AI-generated responses side by side and determine which response better meets user needs.
• Evaluate factual accuracy, relevance, completeness, reasoning, clarity, instruction-following, tone, safety, and overall usefulness.
• Assess content in English, Castilian Spanish, or both across questions, search results, file-based tasks, image-based responses, content-generation requests, and conversations.
• Apply Castilian Spanish conventions, terminology, idioms, tone, and cultural context specific to Spain.
• Document concise, evidence-based rationales and make independent decisions in ambiguous scenarios.
• Complete at least 25 evaluation tasks per day while maintaining accuracy and consistent judgment.

Requirements

• Native-level or professional fluency in Castilian Spanish, including Spanish-from-Spain vocabulary, idioms, tone, and cultural context.
• Strong English fluency and reading comprehension for complex prompts, AI responses, and annotation guidelines.
• Strong analytical, critical-thinking, written communication, and attention-to-detail skills.
• Ability to evaluate varied content for factuality, relevance, reasoning, clarity, instruction-following, cultural appropriateness, and usefulness.
• Ability to work independently, follow detailed evaluation frameworks, maintain focus during repetitive work, and adapt to feedback.
• Must be authorized to work in the United States and reside within a U.S. time zone.

Nice to have

• Experience with side-by-side labeling, data annotation, comparative content evaluation, or quality assessment.
• Experience evaluating AI-generated responses or contributing to model-quality assessment.
• Experience evaluating search relevance, content quality, or user-facing digital experiences.
• Experience working with detailed guidelines, rubrics, or structured decision-making frameworks.

Culture & Benefits

• Structured onboarding, guided practice, calibration, and formal qualification review before production work.
• Ongoing feedback, quality reviews, and calibration support.
• Medical, dental, and vision coverage for eligible employees.
• FSA, 401(k), paid time off, parental leave, and professional growth opportunities.

Hiring process

• Complete structured training and guided practice.
• Demonstrate consistent evaluation judgment through calibration and a formal qualification review.
• Enter production work after successful qualification.