Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
На похожих ролях по рынку
$160к$190кмедиана$220к
11 в выборке
71
Хорошая вакансия
развернуть
Задачи описаны четко и связаны с проверкой инженерных решений, созданных ИИ, но подключение зависит от спроса на программу, а объем задач не гарантирован.
Кликните для подробной информации
Нестабильный поток задачПонятные задачиРабота на стыке с ИИ
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving) (AI/code evaluation): Evaluating production code, debugging traces, and developer-facing AI outputs with an accent on correctness, testing, edge-case handling, and software engineering judgment. Focus on reproducing failures, writing minimal failing tests, ranking paired solutions, and documenting security and code-generation issues.
Location: Remote; US eligibility required
Salary: $90–$120 per hour
Company
hirify.global Human Data evaluates production code, debugging traces, and developer-facing AI outputs against real-world correctness standards.
What you will do
Run and reproduce generated code outputs in a sandboxed environment and execute test suites.
Grade MLOps, LLM performance, kernels, profiling, and serving engineering solutions for correctness, style, and edge-case handling.
Write minimal failing unit tests that demonstrate missed bugs.
Compare paired solutions, rank them against a rubric, and provide written rationale.
Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
Document recurring code-generation failures and calibrate reviews against gold-standard examples.
Requirements
Strong professional engineering experience, including the ability to read, run, and debug unfamiliar code.
Ability to write concise unit tests that capture a single failure mode.
Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
Clear written reasoning suitable for review by another senior engineer.
Reliable asynchronous availability for at least 10 hours per week.
Nice to have
Prior code-review or technical-interview-grading experience.
Open-source contributions or a public portfolio demonstrating production-quality code.
Experience with standard tooling, linters, and idiomatic style guides for the target language.
Familiarity with OWASP and CWE security-review checklists and application-security patterns.
Async work with program-defined task volume and review pacing.
Placement depends on current program demand and reviewer confirmation.
Compensation is paid at an hourly rate of $90–$120.
Hiring process
Confirm profile and eligibility details.
Attach the role to the specialist intake deliberately.
Receive follow-up from the team if the profile fits a current program.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →