aidata engineeringdebuggingpytestunit testingcode reviewsoftware engineeringsecurity review
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
ЗП не указана
На похожих ролях по рынку
$185к$215кмедиана$215к
10 в выборке
57
Средняя вакансия
развернуть
Обязанности понятны и связаны с оценкой ИИ, но формат подрядчика, неясный объём задач и зависимость выхода на проект от спроса делают эту возможность менее предсказуемой.
Кликните для подробной информации
Нестабильная загрузкаРабота по контрактуОценка ИИПонятные задачи
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Member of Technical Staff, Data Engineering (AI): Evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards with an accent on reproducible testing, data engineering quality, and edge-case analysis. Focus on writing minimal failing tests, ranking paired solutions, triaging security issues, and documenting code-generation failures for modeling teams.
Location: Remote; eligible from the United States
Company
hirify.global operates a human-data and coding evaluation program that supports AI model quality through expert engineering reviews.
What you will do
Run and reproduce generated code outputs in a sandboxed environment.
Evaluate data engineering solutions for correctness, style, and edge-case handling.
Write minimal failing unit tests that demonstrate missed bugs.
Compare paired solutions, rank them against a rubric, and provide written reasoning.
Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
Document recurring code-generation failures and calibrate reviews against gold-standard examples to maintain inter-rater agreement.
Requirements
Strong professional engineering experience with the ability to read, run, and debug unfamiliar code.
Ability to write concise unit tests that capture a single failure mode.
Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
Clear written reasoning suitable for review by another senior engineer.
Reliable asynchronous availability for at least 10 hours per week.
Remote work eligibility in the United States.
Nice to have
Prior code-review or technical-interview-grading experience.
Open-source contributions or a public portfolio demonstrating production-quality code.
Experience with standard tooling, linters, and idiomatic style guides for the target language.
Familiarity with security-review checklists such as OWASP and CWE, plus application-security patterns.
Culture & Benefits
Independent specialist contractor arrangement.
Asynchronous work with program-defined task volume and review pacing.
Placement depends on current program demand and reviewer confirmation.
Hourly rate is confirmed after the interview process.
Hiring process
Confirm profile and eligibility details during specialist intake.
Attach the selected role to the application.
Receive follow-up from the recruiting team if the profile fits a current program.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →