Drilling Engineer (AI)

Location: Remote; eligible from the United States

Salary: $85 per hour

Company

AI-focused human-data program that pairs experienced engineers with a modeling team to evaluate code-generation quality and software engineering agents.

What you will do

• Run and reproduce generated code outputs in a sandboxed environment.
• Evaluate engineering review solutions for correctness, style, compileability, runtime behavior, security, and edge-case handling.
• Write minimal failing unit tests that demonstrate missed bugs.
• Compare paired solutions, rank them against a rubric, and provide written rationales.
• Tag failure modes with severity scores and document recurring code-generation failures for the modeling team.
• Calibrate against gold-standard reviews to maintain the required inter-rater agreement.

Requirements

• Strong professional engineering experience with the ability to read, run, and debug unfamiliar production-quality code.
• Comfort writing concise unit tests that capture a single failure mode.
• Familiarity with a testing framework such as pytest, Jest, JUnit, Go test, or RSpec.
• Clear written reasoning suitable for review by another senior engineer.
• Reliable asynchronous availability for at least 10 hours per week.

Nice to have

• Prior code-review or technical-interview-grading experience.
• Open-source contributions or a public portfolio demonstrating production-quality code.
• Experience with the target language's standard tooling, linters, and idiomatic style guides.
• Familiarity with security-review checklists, including OWASP and CWE, and application-security patterns.

Culture & Benefits

• Independent specialist contractor arrangement.
• Remote work with program-defined task volume and review pacing.
• Hourly compensation of $85.
• Placement depends on current program demand and reviewer confirmation.

Hiring process

• Submit an application for the specialist cohort.
• Complete human review after intake and confirm profile and eligibility details.
• Placement follows profile matching, current program demand, and reviewer confirmation.