Назад
Company hidden
9 дней назад

Software Engineer, Python — Codebase Q&A

130$
Формат работы
remote (только USA)
Тип работы
parttime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Software Engineer, Python — Codebase Q&A (AI/code evaluation): Evaluating generated Python code, debugging traces, and developer-facing AI outputs against real-world correctness standards with an accent on reproducible failures, unit tests, and edge-case handling. Focus on reproducing code, ranking paired solutions, triaging security issues, and documenting model failure modes for the modeling team.

Location: Remote; eligible from the United States.

Salary: $130 per hour.

Company

hirify.global Human Data runs specialist human-data and AI-output evaluation programs.

What you will do

  • Run and reproduce Python code outputs in a sandboxed environment.
  • Evaluate Python engineering solutions for correctness, style, and edge-case handling.
  • Write minimal failing unit tests that demonstrate missed bugs.
  • Compare paired solutions and rank them with written rationales tied to a rubric.
  • Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
  • Document recurring code-generation failures and calibrate reviews against gold-standard examples to maintain inter-rater agreement.

Requirements

  • Strong professional Python experience, including reading, running, and debugging unfamiliar code.
  • Ability to write concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
  • Clear written reasoning suitable for review by another senior engineer.
  • Reliable asynchronous availability for at least 10 hours per week.

Nice to have

  • Prior code-review or technical-interview-grading experience.
  • Open-source contributions or a public portfolio demonstrating production-quality code.
  • Experience with Python standard tooling, linters, and idiomatic style guides.
  • Familiarity with security-review checklists such as OWASP and CWE and with AppSec patterns.

Culture & Benefits

  • Remote work as an independent specialist contractor.
  • Program-defined task volume and review pacing.
  • Contractor compensation of $130 per hour.
  • Placement depends on current program demand and reviewer confirmation.

Hiring process

  • Submit an application directly to the recruiting team for the specialist cohort.
  • Complete human review after intake and confirm profile and eligibility details.
  • Placement follows role attachment and reviewer confirmation if the profile fits current program demand.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →