Chatbot & LLM Response Evaluator (AI)

Location: Remote; must be based in the US or Canada.

Pay rate: $17/hour USD.

Company

hirify.global develops data and feedback that help improve the accuracy, consistency, and usefulness of advanced technology systems.

What you will do

• Evaluate outputs from AI models across text, images, video, and documents against detailed criteria.
• Assess quality and identify errors and inconsistencies.
• Write clear, well-reasoned justifications for evaluation decisions.
• Follow detailed written guidelines independently and contribute to the data foundation behind better technology.

Requirements

• Must be based in the US or Canada.
• Bachelor's degree, completed or in progress.
• At least 1 year of experience in a role involving evaluation or review of work against a standard, such as UI/UX design, graphic design, photography, video production, editorial work, research, QA, or technical writing; equivalent experience is considered.
• Excellent written English that is clear, precise, and well-organized.
• Strong attention to detail, critical thinking, sound judgment, and the ability to evaluate creative or technical work against criteria.
• Desktop or laptop running Windows 10 or later or a recent version of macOS; Chromebooks, Linux-based systems, and tablets are not supported.
• Stable high-speed internet with at least 25 Mbps download and 5 Mbps upload.

Culture & Benefits

• Remote contract work with flexible hours.
• Clear guidelines and training.
• Performance feedback and opportunities to grow.
• Mission-driven focus on accuracy and quality.
• High-performing contributors may grow into roles guiding and supporting others, with compensation reflecting added responsibility.