Evaluation Specialist/Recent Grad (AI)

Location: Remote, US

Company

hirify.global engages evaluation specialists and recent graduates for a customer project focused on training and evaluating next-generation AI systems.

What you will do

• Develop original, challenging question-and-answer pairs across diverse subjects to test advanced AI models.
• Research topics in depth and triangulate multiple sources to produce accurate, comprehensive, well-documented answers.
• Create multi-step questions requiring synthesis and analytical reasoning rather than single-source lookups.
• Test questions against AI models, analyze results, and adjust difficulty based on outcomes.
• Document research methods, citations, and logical explanations for answers.
• Refine content from reviewer feedback while following project guidelines and quality standards.

Requirements

• Ability to conduct thorough independent research and critically evaluate information from multiple sources.
• Fluent English with exceptional written precision is required; English does not need to be the first language.
• Ability to craft nuanced, well-structured questions that probe deep understanding.
• Strong self-direction, reliability, and accountability for remote independent project work.
• Open to recent graduates, advanced-degree holders, and candidates from any academic or professional background with demonstrated research and writing expertise.

Nice to have

• Interest in cutting-edge AI and testing the limits of current model capabilities.
• Previous experience in AI training, evaluation, or content creation.

Culture & Benefits

• Remote, independent project work on a high-impact AI initiative.
• Contractor role with output-based compensation paid per task meeting project specifications.
• Minimum weekly task-submission requirements apply, and completion time may vary by experience and workflow.
• Selected experts are expected to start their first tasks within 24–48 hours after onboarding.

Hiring process

• Roles are typically filled within 48 hours.
• Selected candidates must be ready to begin promptly and start initial tasks within 24–48 hours of completing onboarding.