5 дней назад
AI Project Reviewer
75 - 125$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AI Project Reviewer (Education): Evaluating learner projects against detailed rubrics for a new educational product with an accent on consistent pass/fail judgments, constructive feedback, and assessment calibration. Focus on comparing human and AI evaluation outcomes, refining assessment criteria, and documenting reasoning to ensure fair and accurate learner feedback.
Location: Remote, USA
Salary: $75–$125 per hour; disclosed range applies to NYC, California, and Washington and may vary by geographic differential.
Company
is a streaming education platform offering members access to classes from leading instructors across creative, business, lifestyle, sports, and other fields.
What you will do
- Review learner projects against detailed rubrics and make consistent pass/fail judgments.
- Write clear, actionable feedback that helps learners improve.
- Collaborate with learning design and product teams to refine rubrics and assessment criteria.
- Compare human and AI assessment outcomes to identify calibration needs.
- Document the reasoning behind evaluation decisions to support consistency.
Requirements
- 5+ years of experience in assessment, evaluation, or educational feedback roles.
- Ability to consistently apply detailed rubrics across multiple submissions.
- Strong written communication skills and the ability to articulate reasoning clearly.
- Experience providing constructive feedback to support learner growth.
- Ability to work independently while maintaining high standards.
- Willingness to refrain from using AI during evaluations and while writing rationales.
Nice to have
- Experience as an educational mentor, coach, evaluator, teaching assistant, instructor, or consultant in AI or learning design.
- Curiosity about AI-driven evaluation methods.
Culture & Benefits
- Freelance contract with a temporary, project-based engagement.
- Flexible scheduling based on project needs.
- Approximately 20 hours per week.
- Collaboration with product and learning design teams.
- Equal opportunity workplace with reasonable accommodations for qualified individuals with disabilities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
OpenTrain AI
1 час назад
DevOps Engineer for AI Training
50 - 100$
4 дня назад
AI Data Annotator
15$
3 дня назад
AI Permitting Advisor (AI)
4 дня назад
Chief Executives - Freelance AI Trainer Project (AI)
6 - 65$
4 дня назад
Training and Development Specialist (AI Trainer)
8 - 65$
4 дня назад
Securities & Commodities Specialist (AI Trainer)
6 - 65$