Evaluation Specialist/Recent Graduate (AI)

Location: Remote

Salary: $20–$70 per hour; output-based compensation is provided for tasks meeting project specifications and quality requirements.

Company

hirify.global delivers a project focused on advancing artificial intelligence through research and evaluation of advanced AI models.

What you will do

• Develop original, challenging question-and-answer pairs to test advanced AI models across diverse subject areas.
• Conduct in-depth research and cross-verify information using multiple reliable sources.
• Create multi-step questions requiring analytical reasoning, synthesis, and critical thinking.
• Test questions against AI models, analyze responses, and refine question difficulty.
• Document research processes with clear citations, evidence, and logical explanations.
• Revise content based on reviewer feedback while maintaining project guidelines, accuracy, consistency, and clarity.

Requirements

• Strong ability to conduct independent research and critically evaluate information from multiple sources.
• Excellent English writing skills and English fluency are required, with a high level of precision and clarity; English does not need to be the first language.
• Ability to create nuanced, well-structured questions assessing deep understanding and complex reasoning.
• Strong analytical thinking, problem-solving, and information-synthesis skills.
• Self-motivation, reliability, and accountability when working independently in a remote environment.
• Contributors must meet minimum submission requirements and complete a specified number of tasks each week.

Nice to have

• Interest in emerging AI technologies and evaluating the capabilities and limitations of advanced AI models.
• Previous experience in AI training, model evaluation, research, or content creation.
• Recent graduates, advanced-degree holders, and candidates from diverse academic or professional backgrounds are welcome when they demonstrate strong research and writing abilities.

Culture & Benefits

• Remote, independent working environment.
• Contractor role with output-based compensation.
• Task time may vary depending on experience and workflow.
• Selected candidates are expected to begin their first tasks within 24–48 hours after onboarding.

Hiring process

• Positions are typically filled within 48 hours.
• Candidates should be ready to begin promptly.
• Selected candidates complete onboarding before starting their first tasks.