Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
ЗП не указана
На похожих ролях по рынку
$160к$190кмедиана$215к
11 в выборке
65
Средняя вакансия
развернуть
Это специализированная контрактная роль, сфокусированная на оценке моделей ИИ, а не на классической разработке, что может ограничивать долгосрочный карьерный рост.
ML Engineer (MSc. or PhD) (AI Model Evaluation): Evaluating production code, debugging traces, and developer-facing AI outputs with an accent on correctness, testing, and edge-case handling. Focus on reproducing failures, writing minimal failing tests, ranking paired solutions, and documenting security and code-generation issues for modeling teams.
Location: Remote; eligible from the United States
Salary: Hourly rate confirmed after the interview process
Company
hirify.global operates a human data and AI evaluation program pairing experienced engineers with modeling teams to assess generated code and software engineering agents.
What you will do
Run and reproduce generated code outputs in a sandboxed environment.
Grade ML engineering solutions for correctness, style, and edge-case handling.
Write minimal failing unit tests that demonstrate missed bugs.
Compare paired solutions, rank them, and provide written rationale tied to the rubric.
Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
Document recurring code-generation failures and calibrate reviews against gold-standard examples to maintain inter-rater agreement above target.
Requirements
MSc. or PhD and strong professional engineering experience, including the ability to read, run, and debug unfamiliar code.
Ability to write concise unit tests capturing a single failure mode.
Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
Clear written reasoning suitable for review by another senior engineer.
Reliable asynchronous availability for at least 10 hours per week.
Nice to have
Prior code-review or technical-interview-grading experience.
Open-source contributions or a public portfolio demonstrating production-quality code.
Experience with standard tooling, linters, and idiomatic style guides for the target language.
Familiarity with security-review checklists, OWASP, CWE, and application security patterns.
Culture & Benefits
Remote work as an independent specialist contractor.
Expected contractor arrangement with program-defined task volume and review pacing.
Hourly compensation confirmed after the interview process.
Placement depends on current program demand and reviewer confirmation.
Hiring process
Confirm profile and eligibility details.
Attach the role deliberately during specialist intake.
Receive follow-up from the recruiting team if the profile fits a current program.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →