Social Media Annotator (AI)

TL;DR

Social Media Annotator (AI): Reviewing and assessing social media content and AI model outputs to improve language model accuracy with an accent on factual correctness, logical soundness, and cultural nuances. Focus on evaluating model responses, capturing error traces, and optimizing prompt engineering metrics.

Location: Must be based in the United States of America

Salary: $16–$28 per hour

Company

hirify.global provides high-quality training data to power the next generation of large-scale AI language models.

What you will do

• Review videos, posts, and other social media media to verify if specific criteria are met.
• Assess AI model outputs across various categories for accuracy and quality.
• Engage in conversations with the model to test linguistic scenarios.
• Verify factual accuracy and logical soundness of model responses.
• Capture reproducible error traces to facilitate model improvement.
• Suggest enhancements for prompt engineering and evaluation metrics.

Requirements

• Location: Must be based in the United States of America.
• English: Native-level fluency required.
• Deep practical understanding of social media trends and cultural nuances.
• Ability to provide clear, metacognitive communication ("showing your work").
• Access to a secure computer and high-speed internet.

Nice to have

• Experience in content moderation.
• Experience in digital media analysis.
• Experience with community-based projects.

Culture & Benefits

• Flexible freelance/contract work arrangement.
• Opportunity to shape the future of AI and democratize education and research.
• Competitive hourly pay determined by experience and expertise.