Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
развернуть
На похожих ролях по рынку
$190к$220кмедиана$220к
10 в выборке
68
Хорошая вакансия
развернуть
Задачи описаны чётко и дают практический опыт оценки ИИ, но выход на проект зависит от спроса, а объём работы не гарантирован.
Объём не гарантирован
Понятные задачи
Опыт в оценке ИИ
Актуальный стек
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Software Engineer, Python — Codebase Q&A (AI/code evaluation): Evaluating generated Python code, debugging traces, and developer-facing AI outputs against real-world correctness standards with an accent on reproducible failures, unit tests, and edge-case handling. Focus on reproducing code, ranking paired solutions, triaging security issues, and documenting model failure modes for the modeling team.
Location: Remote; eligible from the United States.
Salary: $130 per hour.
Company
hirify.global Human Data runs specialist human-data and AI-output evaluation programs.
What you will do
Run and reproduce Python code outputs in a sandboxed environment.
Evaluate Python engineering solutions for correctness, style, and edge-case handling.
Write minimal failing unit tests that demonstrate missed bugs.
Compare paired solutions and rank them with written rationales tied to a rubric.
Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
Document recurring code-generation failures and calibrate reviews against gold-standard examples to maintain inter-rater agreement.
Requirements
Strong professional Python experience, including reading, running, and debugging unfamiliar code.
Ability to write concise unit tests that capture a single failure mode.
Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
Clear written reasoning suitable for review by another senior engineer.
Reliable asynchronous availability for at least 10 hours per week.
Nice to have
Prior code-review or technical-interview-grading experience.
Open-source contributions or a public portfolio demonstrating production-quality code.
Experience with Python standard tooling, linters, and idiomatic style guides.
Familiarity with security-review checklists such as OWASP and CWE and with AppSec patterns.
Culture & Benefits
Remote work as an independent specialist contractor.
Program-defined task volume and review pacing.
Contractor compensation of $130 per hour.
Placement depends on current program demand and reviewer confirmation.
Hiring process
Submit an application directly to the recruiting team for the specialist cohort.
Complete human review after intake and confirm profile and eligibility details.
Placement follows role attachment and reviewer confirmation if the profile fits current program demand.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →