Chinese-Speaking Language Evaluation Expert (AI)

Location: Remote, Australia

Rate: $40 per hour

Company

Welo Data’s AI Services team is launching a language evaluation project focused on validating search-related AI responses.

What you will do

• Identify realistic search-related failures in AI-generated responses.
• Create and test search queries to find issues such as poor local relevance, weak source quality, outdated information, language mismatches, and incomplete answers.
• Document failure cases and explain what went wrong.
• Write instructions and evaluation criteria for correct answers.
• Test multiple queries iteratively before confirming a failure.

Requirements

• Chinese-language expertise and deep familiarity with the relevant local context.
• Research skills, including finding and verifying information across websites, databases, and documentation.
• Critical thinking and the ability to identify contradictions, outdated information, and region-specific inapplicability.
• Strong attention to detail when evaluating language nuances, local variations, prices, regulations, requirements, and edge cases.
• Clear writing skills for explaining reasoning, instructions, and evaluation rubrics.
• Availability for 20 hours per week.

Nice to have

• Background in research, quality assurance, compliance, or another precision-focused field involving source verification.
• Knowledge of local regulations, business practices, and cultural nuances.

Culture & Benefits

• Remote freelance contract based in Australia.
• Ongoing project with an ASAP start.
• Part-time commitment of 20 hours per week.
• Hourly rate of $40.