Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
$35к-50к/год
$100к$140кмедиана$180к
По похожим ролям (14) ~ $140к/год
На СНГ рынке: $1к/мес ($738 - $2.2к)
49
Средняя вакансия
развернуть
Задачи внятно связаны с оценкой инженерных решений для ИИ, но формат подрядчика, ограниченный объём задач и зависимость начала работы от спроса делают эту возможность менее предсказуемой.
Кликните для подробной информации
Объём задач неясенРабота с оценкой ИИПонятные задачиРабота по контракту
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Customer Success Engineer (LatAm) (AI code evaluation): Evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards with an accent on reproducible failures, unit tests, and software engineering judgment. Focus on reproducing generated code, ranking paired solutions, triaging security issues, and documenting failure modes for the modeling team.
Location: Remote; eligible from the US.
Salary: $35,000–$50,000 per year.
Company
hirify.global operates a human data and coding evaluation program for improving AI and software engineering model quality.
What you will do
Run and reproduce generated code outputs in a sandboxed environment.
Evaluate engineering review solutions for correctness, style, and edge-case handling.
Write minimal failing unit tests that demonstrate missed bugs.
Compare paired solutions and rank them with written rationales tied to a rubric.
Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
Document recurring code-generation failures and calibrate against gold-standard reviews to maintain inter-rater agreement.
Requirements
Strong day-job engineering experience, including the ability to read, run, and debug unfamiliar code.
Ability to write concise unit tests that capture a single failure mode.
Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
Clear written reasoning suitable for review by another senior engineer.
Reliable asynchronous availability for at least 10 hours per week.
Nice to have
Prior code-review or technical-interview-grading experience.
Open-source contributions or a public portfolio demonstrating production-quality code.
Experience with standard tooling, linters, and idiomatic style guides for the target language.
Familiarity with security-review checklists such as OWASP and CWE and with application-security patterns.
Culture & Benefits
Remote work as an independent specialist contractor.
Contractor arrangement with program-defined task volume and review pacing.
Placement depends on current program demand and reviewer confirmation.
Hiring process
Confirm profile and eligibility details.
Attach the role deliberately during specialist intake.
Receive follow-up if the profile fits a current program; placement timing depends on program demand and reviewer confirmation.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →