Search Engine Evaluation Specialist (AI)

TL;DR

Search Engine Evaluation Specialist (AI): Designing complex evaluation frameworks and producing high-quality training data for AI models with an accent on search rank response analysis and indexing logic. Focus on creating professional-grade prompts, structured rubrics, and benchmarking data to improve search intent interpretation.

Location: Remote (Must be based in the United States)

Salary: $20 per hour

Company

An agency providing expert-crafted training data and benchmark evaluations for AI model refinement.

What you will do

• Design complex evaluation frameworks and produce structured training data for AI models.
• Generate high-quality prompts that compel AI to produce professional-grade deliverables regarding indexing logic and query relevance.
• Create objective, non-ambiguous scoring rubrics to eliminate subjective interpretation in model evaluation.
• Perform meticulous fact-checking of search rankings against official quality rating guidelines.
• Develop clean, reliable benchmark data to aid in the refinement of AI models handling SEO tasks.

Requirements

• Professional expertise in SEO, search quality rating, or digital marketing.
• Deep understanding of indexing, ranking factors, and search response evaluation.
• Must be based in the United States of America.
• Strong writing and prompt generation skills for complex AI training scenarios.
• Proficiency in rubric generation and creating objective scoring criteria.
• Ability to operate autonomously as an independent contractor.

Culture & Benefits

• Fully remote work arrangement.
• High level of autonomy in designing frameworks and deliverables.
• Engagement as a freelance independent contractor.