AI Model Evaluator (AI)

Location: Remote; must be based in the US or Canada

Pay rate: $17/hour (USD)

Company

hirify.global provides data labeling and evaluation work that generates examples and feedback for improving advanced technology systems.

What you will do

• Evaluate text, image, video, and document outputs from AI models against detailed criteria.
• Assess quality and identify errors, inconsistencies, and other issues.
• Write clear, precise, and well-reasoned justifications for evaluation decisions.
• Follow detailed written guidelines independently and contribute to improving model accuracy and consistency.

Requirements

• Bachelor’s degree, completed or in progress.
• Must be based in the US or Canada.
• Excellent written English that is clear, precise, and well-organized.
• Strong attention to detail, critical thinking, sound judgment, and the ability to evaluate creative or technical work against criteria.
• At least 1 year of experience evaluating or reviewing work against a standard, such as UI/UX design, graphic design, photography, video production, editorial work, research, QA, or technical writing; equivalent experience is considered.
• Desktop or laptop running Windows 10 or later, or a recent version of macOS. Chromebooks, Linux-based systems, and tablets are not supported.
• Stable high-speed internet with at least 25 Mbps download and 5 Mbps upload.

Culture & Benefits

• Remote contract work with flexible hours.
• Clear guidelines and training.
• Performance feedback and opportunities to grow.
• Mission-driven work focused on accuracy and quality.
• High-performing contributors may progress into roles guiding and supporting others, with compensation reflecting added responsibility.