Назад
Company hidden
25 дней назад

Strategic Project Lead, Coding/SWE

Формат работы
remote (только USA)
Тип работы
parttime
Грейд
lead
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Strategic Project Lead, Coding/SWE (AI Code Evaluation): Evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards with an accent on reproduction, unit testing, and software engineering judgment. Focus on writing minimal failing tests, ranking paired solutions, triaging security issues, and documenting recurring code-generation failures.

Location: Remote; eligible from the United States

Salary: Hourly rate confirmed after the interview process

Company

hirify.global operates a human data and AI evaluation program that pairs experienced engineers with modeling teams to assess code-generation quality.

What you will do

  • Run and reproduce generated code outputs in a sandboxed environment, including debugging traces and software engineering agent results.
  • Grade coding and software engineering review solutions for correctness, style, and edge-case handling.
  • Write minimal failing unit tests that demonstrate missed bugs.
  • Compare paired solutions, rank them against a rubric, and provide written rationales.
  • Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
  • Document recurring code-generation failures and calibrate against gold-standard reviews to maintain inter-rater agreement.

Requirements

  • Strong day-job engineering experience with the ability to read, run, and debug unfamiliar production code.
  • Ability to write concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
  • Clear written reasoning suitable for review by another senior engineer.
  • Reliable asynchronous availability for at least 10 hours per week.

Nice to have

  • Prior code-review or technical-interview-grading experience.
  • Open-source contributions or a public portfolio demonstrating production-quality code.
  • Experience with standard tooling, linters, and idiomatic style guides for the target language.
  • Familiarity with OWASP, CWE, security-review checklists, and application security patterns.

Culture & Benefits

  • Remote independent specialist contractor arrangement.
  • Program-defined task volume and review pacing.
  • Placement depends on current program demand and reviewer confirmation.
  • Work focuses on asynchronous engineering review and collaboration with a modeling team.

Hiring process

  • Submit an application for the specialist cohort.
  • Complete human review after intake and confirm profile and eligibility details.
  • Receive follow-up if the profile fits a current program; placement timing depends on program demand and reviewer confirmation.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →