AI Translation Evaluator (Arabic-English)

TL;DR

AI Translation Evaluator (Arabic-English): Evaluating context-dependent translations produced by an AI chatbot with an accent on MQM error annotations and rubric verification. Focus on ensuring accuracy, quality, and adherence to user-specified requirements for Arabic-English pairs.

Location: Remote (Global)

Company

hirify.global is a platform specializing in AI training and high-quality data collection for AI systems.

What you will do

• Review conversation history and translation requests with additional contextual instructions.
• Apply MQM error annotations with appropriate categories and severity levels.
• Verify auto-generated rubric items for relevance and mark spurious items.
• Evaluate rubric items as Pass or Fail based on user-stated requirements.
• Provide accurate and consistent ratings according to project guidelines.

Requirements

• Native Arabic speaker with a strong command of English.
• Professional translator, language specialist, or Master's Degree in a language-related field.
• Keen attention to detail.
• Access to a stable internet connection and a computer.

Culture & Benefits

• Opportunity to help shape AI systems for accurate, context-aware multilingual translations.
• Flexible, project-based engagement as an independent contractor.
• Remote work from any location.