AI Evaluation Specialist (Italian)

TL;DR

AI Evaluation Specialist (Italian): Assessing and improving the quality of AI-generated responses in Italian with an accent on accuracy, cultural appropriateness, and linguistic nuance. Focus on performing side-by-side analysis of AI outputs and applying structured annotation guidelines to real user queries.

Location: Remote (Must be based in the USA)

Salary: $30.00 – $35.00 USD per hour

Company

A technology solutions firm that leverages cutting-edge technology to connect strategy, business solutions, and products to help organizations grow.

What you will do

• Evaluate and compare AI-generated responses in Italian for accuracy and relevance.
• Conduct side-by-side analysis of outputs from various AI systems.
• Assess responses for clarity, tone, and adherence to instructions.
• Identify linguistic nuances and cultural context in Italian.
• Apply structured annotation guidelines to datasets of real user queries.

Requirements

• Native or professional fluency in Italian
• Strong English reading comprehension
• Analytical thinking and high attention to detail.
• Experience with structured evaluation or guidelines.

Nice to have

• Background in linguistics, translation, or localization.
• Experience with data annotation, AI evaluation, or search relevance.

Culture & Benefits

• Comprehensive health coverage including medical, dental, and vision.
• Financial perks such as a 401k program and Flexible Spending Account.
• Competitive PTO offerings and parental leave.
• Opportunities for professional growth and development.