Senior Backend Engineer (AI Evaluation)

Location: Remote; eligible from the US.

Company

hirify.global Human Data pairs experienced engineers with modeling teams to evaluate production code and developer-facing AI outputs.

What you will do

• Run and reproduce generated backend code in a sandboxed environment and execute test suites.
• Grade engineering solutions for correctness, style, edge-case handling, and severity of failure modes.
• Write minimal failing unit tests that demonstrate bugs missed by generated code.
• Compare paired solutions, rank them against a rubric, and provide written rationales.
• Triage issues including compile errors, runtime crashes, off-by-one errors, and security problems.
• Document recurring code-generation failures and calibrate reviews against gold-standard evaluations.

Requirements

• Strong day-job engineering experience sufficient to read, run, and debug unfamiliar backend code.
• Comfort writing concise unit tests that capture a single failure mode.
• Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
• Clear written reasoning that can convince another senior engineer.
• Reliable asynchronous availability for at least 10 hours per week.

Nice to have

• Prior code-review or technical-interview-grading experience.
• Open-source contributions or a public portfolio demonstrating production-quality code.
• Experience with standard tooling, linters, and idiomatic style guides for the target language.
• Familiarity with security-review checklists such as OWASP and CWE and with application-security patterns.

Culture & Benefits

• Remote work as an independent specialist contractor.
• Contractor arrangement with program-defined task volume and review pacing.
• Hourly compensation confirmed after the interview process.
• Placement depends on current program demand and reviewer confirmation.

Hiring process

• Confirm profile and eligibility details during specialist intake.
• Attach the selected role and submit the application directly to the recruiting team.
• Receive follow-up if the profile fits a current program; placement timing depends on demand and reviewer confirmation.