7 дней назад
Educator/Assessor Writer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Educator/Assessor Writer (AI): Evaluating and comparing AI-generated content using rubrics for clarity, accuracy, tone, helpfulness, and instruction adherence with an accent on educational assessment, academic writing, and objective grading. Focus on identifying unsupported claims and content gaps, assigning reasoned quality scores, and maintaining consistent evaluation decisions across asynchronous review workflows.
Location: Remote
Company
supports an AI evaluation project focused on assessing and improving AI-generated content.
What you will do
- Evaluate and compare AI-generated responses for clarity, accuracy, tone, helpfulness, and adherence to instructions.
- Apply provided rubrics, guidelines, and evaluation criteria to assign quality scores.
- Write clear rationales and identify unsupported claims, inaccuracies, inconsistencies, and content gaps.
- Assess whether responses are appropriate and practical for their intended audiences.
- Document decisions accurately and collaborate asynchronously with project managers and reviewers through digital content review platforms.
- Maintain consistency and objectivity while meeting project deadlines.
Requirements
- Native or near-native written English fluency.
- A degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
- Experience grading, marking, or evaluating written work against established criteria or rubrics.
- Background in assessment design, instructional design, academic writing, peer review, or thesis supervision.
- Strong critical-analysis, written communication, and attention-to-detail skills.
- Ability to work independently and meet project deadlines.
Nice to have
- Experience with AI model evaluation or data annotation.
- Familiarity with RLHF or AI training workflows.
- Experience using digital assessment or content review platforms.
- Strong understanding of educational assessment and rubric design.
Culture & Benefits
- Fully remote work.
- Contractor engagement that can be completed alongside other professional commitments.
- Asynchronous collaboration with project managers and reviewers.
- No prior AI experience is required.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
8 дней назад
AI Data Annotator
20$
13 дней назад
Language Alignment & Resource Partner - Freelance AI Trainer Project (AI)
10 - 65$
12 дней назад
PhD Developmental Psychology Expert (AI)
12 дней назад
Welsh Audio Specialist - Freelance AI Trainer Project (AI)
6 - 65$
11 дней назад
AI Research Peer Review Evaluator (ML/AI)
13 дней назад
Japanese Language Data Contributor (Multimodal) – Freelance AI Trainer Project (AI)
6 - 65$