Chinese-Speaking AI Evaluation Specialist (AI)

TL;DR

Chinese-Speaking AI Evaluation Specialist (AI): Assessing and improving the quality of AI-generated responses in Chinese with an accent on linguistic accuracy and cultural appropriateness. Focus on performing side-by-side analysis of model outputs and applying structured annotation guidelines to ensure high-quality AI communication.

Location: Remote (US)

Salary: $30.00 - $35.00 per hour

Company

A technology solutions firm that helps organizations unlock value from assets by leveraging cutting-edge technology to create new revenue streams and business lines.

What you will do

• Evaluate and compare AI-generated responses in Chinese for accuracy, relevance, and clarity.
• Perform side-by-side analysis of outputs from different AI systems to determine quality.
• Identify subtle nuances in meaning, tone, and cultural context within Chinese outputs.
• Apply structured annotation guidelines consistently to real user query datasets.
• Ensure AI systems follow instructions and respond appropriately to real-world queries.

Requirements

• Native or professional fluency in Chinese
• Strong English reading comprehension
• Analytical thinking and high attention to detail.
• Experience working with structured evaluation frameworks or guidelines.

Nice to have

• Background in linguistics, translation, or localization.
• Experience with data annotation, AI evaluation, or search relevance.

Culture & Benefits

• Comprehensive health coverage including medical, dental, and vision.
• Financial security via 401k program and Flexible Spending Account.
• Competitive PTO offerings and Parental Leave.
• Opportunities for professional growth and development within a bold and agile team.