8 дней назад
Software Engineer Task Author (AI Training)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Software Engineer Task Author (AI Training) (AI engineering and debugging): Designing and validating realistic engineering tasks that train AI agents to diagnose integration failures, trace bugs through codebases, and implement configuration or integration fixes with an accent on production-grade debugging, observability, and precise scoring criteria. Focus on building plausible task environments, verifying fixes in live or simulated systems, and calibrating difficulty across logs, failure modes, and code complexity.
Location: Fully remote and flexible
Compensation: Hourly contract with weekly payouts.
Company
is building datasets of expert tasks to train and evaluate advanced AI agents on real enterprise software engineering work.
What you will do
- Author realistic engineering tasks involving integration failures, log-based debugging, source-code bug tracing, and configuration fixes.
- Write precise scoring rubrics defining correct diagnoses, fixes, and verification procedures.
- Set up task environments with realistic codebases, logs, alerts, and system states.
- Solve and verify each task yourself in a live or simulated environment.
- Calibrate task difficulty by adjusting code complexity, log volume, failure modes, and ambiguity.
- Review and correct AI-drafted prompts and rubrics.
Requirements
- Hands-on, industry-level experience as a working software engineer.
- Fluency in Git, version-control workflows, and code review practices.
- Strong debugging skills, including reading logs, using observability tools, and tracing failures through codebases.
- Experience with infrastructure, integrations, APIs, services, configuration files, and CI/CD.
- Ability to write and verify code fixes and define precise, checkable correctness criteria.
- Strong written communication skills in English.
Nice to have
- Experience in manufacturing, automotive software, industrial IoT, or enterprise SaaS engineering.
- Experience with Datadog, Grafana, or PagerDuty.
- Familiarity with embedded systems, OT/IT integration, or SCADA environments.
Culture & Benefits
- Work on cutting-edge AI projects alongside leading research labs.
- Freelance autonomy with meaningful, well-defined task-based work.
- Flexible hours and fully remote work.
- Weekly payouts.
- Potential for ongoing work and contract extension as new projects launch.
Hiring process
- Quick screening process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
AI Training Data Contributor (Software Engineering)
40 - 100$
2 дня назад
SWE-Bench AI Task Auditor - Freelance AI Trainer Project
70 - 100$
2 дня назад
AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project
70 - 100$
3 дня назад
AI Quality Analyst (AI)
2 дня назад
AWS Serverless & IaC AI Task Auditor - Freelance AI Trainer Project
70 - 100$
2 дня назад
AWS Trainium/NKI (TRN) AI Task Auditor (AI)
70 - 100$