Назад
Company hidden
3 дня назад

MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

90 - 120$
Формат работы
remote (только USA)
Тип работы
parttime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving) (AI/code evaluation): Evaluating production code, debugging traces, and developer-facing AI outputs with an accent on correctness, testing, edge-case handling, and software engineering judgment. Focus on reproducing failures, writing minimal failing tests, ranking paired solutions, and documenting security and code-generation issues.

Location: Remote; US eligibility required

Salary: $90–$120 per hour

Company

hirify.global Human Data evaluates production code, debugging traces, and developer-facing AI outputs against real-world correctness standards.

What you will do

  • Run and reproduce generated code outputs in a sandboxed environment and execute test suites.
  • Grade MLOps, LLM performance, kernels, profiling, and serving engineering solutions for correctness, style, and edge-case handling.
  • Write minimal failing unit tests that demonstrate missed bugs.
  • Compare paired solutions, rank them against a rubric, and provide written rationale.
  • Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
  • Document recurring code-generation failures and calibrate reviews against gold-standard examples.

Requirements

  • Strong professional engineering experience, including the ability to read, run, and debug unfamiliar code.
  • Ability to write concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
  • Clear written reasoning suitable for review by another senior engineer.
  • Reliable asynchronous availability for at least 10 hours per week.

Nice to have

  • Prior code-review or technical-interview-grading experience.
  • Open-source contributions or a public portfolio demonstrating production-quality code.
  • Experience with standard tooling, linters, and idiomatic style guides for the target language.
  • Familiarity with OWASP and CWE security-review checklists and application-security patterns.

Culture & Benefits

  • Remote independent specialist contractor arrangement.
  • Async work with program-defined task volume and review pacing.
  • Placement depends on current program demand and reviewer confirmation.
  • Compensation is paid at an hourly rate of $90–$120.

Hiring process

  • Confirm profile and eligibility details.
  • Attach the role to the specialist intake deliberately.
  • Receive follow-up from the team if the profile fits a current program.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →