AI Response Evaluator (AI)

Location: Fully remote from Argentina, Brazil, Chile, Colombia, the Czech Republic, Ecuador, Estonia, France, Germany, Italy, Mexico, Paraguay, Peru, Poland, Portugal, Spain, or Uruguay

No salary specified

Company

hirify.global creates training and evaluation data for frontier AI models.

What you will do

• Review AI-generated customer service responses and technical content.
• Evaluate clarity, helpfulness, natural language, technical accuracy, and overall quality.
• Use coding knowledge to assess technical correctness and identify errors.
• Read, validate, and troubleshoot JSON structure, syntax, and formatting.
• Check outputs against project guidelines and provide clear, well-reasoned feedback.

Requirements

• Fluency in at least one supported language variety: Dutch, Welsh, French, German, Italian, Portuguese, or Greek.
• Solid understanding of JSON syntax, structure, validation, and troubleshooting.
• Coding knowledge sufficient to assess technical content and identify errors.
• Strong judgment, attention to detail, and written communication skills.
• Ability to follow detailed evaluation guidelines consistently.

Nice to have

• Experience in AI evaluation, quality assurance, or technical support.
• Experience working with APIs and structured data.
• Background in customer service, software development, or technical writing.

Culture & Benefits

• Independent contractor engagement.
• Part-time project lasting up to three months.
• Remote work from the listed countries.
• Voice responses should be natural and spontaneous, with responses up to one minute.