Назад
Company hidden
2 дня назад

ML Engineer (Coding Agent Experience)

85$
Формат работы
remote (только USA)
Тип работы
parttime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
ML Engineer (Coding Agent Experience) (AI/code evaluation): Evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards with an accent on reproduction, testing, and software engineering judgment. Focus on writing minimal failing tests, triaging security issues, ranking paired solutions, and documenting code-generation failures for modeling teams.

Location: Remote; eligible from the US

Salary: $85 per hour

Company

hirify.global Human Data pairs experienced engineers with modeling teams to evaluate production code and developer-facing AI outputs.

What you will do

  • Run and reproduce generated code outputs in a sandboxed environment.
  • Evaluate machine learning and software engineering solutions for correctness, style, and edge-case handling.
  • Write minimal failing unit tests that demonstrate missed bugs.
  • Compare paired solutions and rank them with written rationales tied to the rubric.
  • Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
  • Document recurring code-generation failures and calibrate reviews against gold-standard examples.

Requirements

  • Strong professional engineering experience with the ability to read, run, and debug unfamiliar code.
  • Comfort writing concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
  • Clear written reasoning suitable for review by another senior engineer.
  • Reliable asynchronous availability for at least 10 hours per week.

Nice to have

  • Prior code-review or technical-interview-grading experience.
  • Open-source contributions or a public portfolio demonstrating production-quality code.
  • Experience with standard tooling, linters, and idiomatic style guides for the target language.
  • Familiarity with OWASP, CWE, security-review checklists, and application security patterns.

Culture & Benefits

  • Remote independent specialist contractor arrangement.
  • Program-defined task volume and review pacing.
  • Placement depends on current program demand and reviewer confirmation.

Hiring process

  • Confirm profile and eligibility details.
  • Attach the role to the application deliberately.
  • Receive follow-up from the recruiting team if the profile fits a current program.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →