AI/ML Engineer, Internal Platforms

Location: Remote; eligible from the United States

Company

hirify.global operates a human-data and AI evaluation program that pairs experienced engineers with modeling teams to assess production-quality code and developer-facing AI outputs.

What you will do

• Run and reproduce generated code outputs in a sandboxed environment, including test-suite execution and debugging-trace analysis.
• Evaluate ML engineering solutions for correctness, style, edge-case handling, and software engineering quality.
• Write minimal failing unit tests that demonstrate bugs or missed edge cases.
• Compare paired solutions, rank them against a rubric, and provide written rationales.
• Tag failure modes such as compile errors, runtime crashes, off-by-one errors, and security issues with severity scores.
• Document recurring code-generation failures and calibrate reviews against gold-standard examples to maintain target inter-rater agreement.

Requirements

• Strong professional engineering experience with the ability to read, run, and debug unfamiliar code.
• Ability to write concise unit tests that capture a single failure mode.
• Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
• Clear written reasoning sufficient to justify review conclusions to another senior engineer.
• Reliable asynchronous availability for at least 10 hours per week.

Nice to have

• Prior code-review or technical-interview-grading experience.
• Open-source contributions or a public portfolio demonstrating production-quality code.
• Experience with standard tooling, linters, and idiomatic style guides for the target language.
• Familiarity with OWASP, CWE, security-review checklists, and application-security patterns.

Culture & Benefits

• Remote work as an independent specialist contractor.
• Async review schedule with program-defined task volume and pacing.
• Contractor arrangement with placement dependent on current program demand and reviewer confirmation.

Hiring process

• Submit an application for the specialist cohort.
• Confirm profile and eligibility details during intake.
• Placement follows human review and depends on program demand and reviewer confirmation.