AI Response Labeler / Annotator (Italian)

Location: Remote within Mexico. During the approximately 30-day training and qualification period, work is required from 9:00 a.m. to 5:00 p.m. Pacific Time; afterward, standard business hours may be worked within the local time zone.

Salary: MXN $255–MXN $290 per hour. Estimated full-time monthly equivalent: MXN $40,800–MXN $46,400.

Company

hirify.global is a technology solutions firm delivering AI, cloud, data, product development, and emerging-technology services.

What you will do

• Compare AI-generated responses side by side and determine which response better meets the user’s needs.
• Evaluate factual accuracy, relevance, completeness, reasoning, clarity, instruction-following, tone, safety, and overall usefulness.
• Assess English, Italian, and combined-language content across questions and answers, search results, file-based tasks, image-based responses, content-generation requests, and conversations.
• Apply Italian linguistic and cultural expertise, including terminology, idioms, regional conventions, tone, and cultural context specific to Italy.
• Apply scenario-specific annotation guidelines consistently, make independent decisions, and document concise, evidence-based rationales.
• Complete a high volume of evaluations while meeting productivity expectations of approximately 25 tasks per day.

Requirements

• Native-level or professional fluency in Italian, with deep familiarity with Italian language conventions and cultural context.
• Strong English fluency and reading comprehension for complex prompts, AI-generated responses, and detailed annotation guidelines.
• Strong analytical, critical-thinking, written communication, and judgment skills.
• Ability to evaluate factuality, relevance, reasoning, clarity, instruction-following, cultural appropriateness, and overall usefulness.
• Excellent attention to detail and ability to maintain consistent accuracy during repetitive, high-volume work.
• Successful completion of structured training and qualification is required before production work.

Nice to have

• Experience with side-by-side labeling, data annotation, comparative content evaluation, or quality assessment.
• Experience evaluating AI-generated responses or contributing to model-quality assessment.
• Experience evaluating search relevance, content quality, factual accuracy, or digital user experiences.
• Experience working with detailed guidelines, rubrics, or structured decision-making frameworks.

Culture & Benefits

• Employment through an Employer of Record partner supporting local compliance, payroll, and benefits in Mexico.
• Medical, dental, and vision coverage may be available.
• Flexible Spending Account, 401(k), paid time off, and parental leave may be available.
• Professional growth and development opportunities.
• Ongoing feedback, quality reviews, and calibration support after entering production.

Hiring process

• Complete structured onboarding, training sessions, guided practice, and calibration exercises.
• Pass a formal qualification review covering evaluation judgment, guideline adherence, decision explanations, and expected productivity.