French-Speaking AI Evaluation Specialist

TL;DR

French-Speaking AI Evaluation Specialist (AI): Assess and improve the quality of AI-generated responses to real user queries in French, ensuring outputs are accurate, relevant, and culturally appropriate. Focus on performing side-by-side analysis, identifying nuances in meaning, tone, and cultural context, and applying structured annotation guidelines consistently.

Location: Remote

Salary: $30.00 to $35.00 USD/hour

Company

Technology solutions firm headquartered in Bellevue, Washington, using cutting-edge technology to bridge strategy and execution across industries.

What you will do

• Evaluate and compare AI-generated responses in French
• Perform side-by-side analysis of outputs from different AI systems
• Assess responses for accuracy, relevance, clarity, and instruction-following
• Identify nuances in meaning, tone, and cultural context
• Apply structured annotation guidelines consistently
• Work with datasets of real user queries

Requirements

• Native or professional fluency in French
• Strong English reading comprehension
• Analytical thinking and attention to detail
• Experience with structured evaluation or guidelines

Nice to have

• Background in linguistics, translation, or localization
• Experience with data annotation, AI evaluation, or search relevance

Culture & Benefits

• Medical, dental, and vision coverage
• Flexible Spending Account
• 401k program
• Competitive PTO offerings
• Parental Leave
• Opportunities for professional growth and development