Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
ЗП не указана
На похожих ролях по рынку
$185к$215кмедиана$215к
10 в выборке
54
Средняя вакансия
развернуть
Задачи по оценке AI-разработок описаны понятно, но ставка не подтверждена, а начало работы зависит от спроса на программу, поэтому предсказуемость вакансии ограничена.
Кликните для подробной информации
Ставка неизвестнаРабота зависит от спросаПонятные задачиРабота с AI
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
UI Engineer (AI): Evaluating generated production code, debugging traces, and developer-facing AI outputs with an accent on reproducibility, unit testing, and edge-case analysis. Focus on reproducing failures, ranking paired solutions, tagging security and runtime issues, and documenting coding-model weaknesses for the modeling team.
Location: Remote; eligible from the United States.
Company
hirify.global operates a Human Data program that evaluates production code, debugging traces, and developer-facing AI outputs against real-world correctness standards.
What you will do
Run and reproduce generated code outputs in a sandboxed environment.
Evaluate engineering review solutions for correctness, style, and edge-case handling.
Write minimal failing unit tests that demonstrate missed bugs.
Compare paired solutions, rank them against a rubric, and provide written rationales.
Tag compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
Document recurring code-generation failures and calibrate reviews against gold-standard examples.
Requirements
Strong professional engineering experience with the ability to read, run, and debug unfamiliar code.
Comfort writing concise unit tests that capture a single failure mode.
Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
Clear written reasoning that can convince another senior engineer.
Reliable async availability for at least 10 hours per week.
Nice to have
Prior code-review or technical-interview-grading experience.
Open-source contributions or a public portfolio demonstrating production-quality code.
Experience with standard tooling, linters, and idiomatic style guides for the target language.
Familiarity with OWASP and CWE security-review checklists and application-security patterns.
Hourly rate confirmed after the interview process.
Placement depends on current program demand and reviewer confirmation.
Hiring process
Confirm profile and eligibility details during specialist intake.
Attach the role to the application deliberately.
Receive follow-up from the recruiting team if the profile fits a current program.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →