Research Engineer (AI)

TL;DR

Research Engineer (AI): Building evaluation frameworks and research systems to measure and validate enterprise intelligence for Fortune 500 organizations with an accent on model quality, process conformance, and productivity measurement. Focus on designing evaluation pipelines, creating ground truth datasets from messy enterprise data, and optimizing LLM performance.

Location: In-person in San Francisco, CA. Relocation available via E3 sponsorship for Australians.

Salary: $120,000 – $320,000 + Equity

Company

hirify.global is an AI startup enabling the autonomous Enterprise, backed by Accel and Princeton research labs.

What you will do

• Design evaluation pipelines to measure accuracy, precision, and recall across classification tasks.
• Build ground truth datasets from ambiguous, real-world enterprise data.
• Run systematic prompt engineering experiments to optimize LLM performance.
• Develop A/B testing infrastructure for model comparison.
• Research novel approaches to process understanding, activity classification, and intent extraction.
• Build automated world-model training infrastructure from the company ontology.

Requirements

• Strong Python fundamentals and software engineering discipline.
• Expertise in LLM prompt engineering (token efficiency, few-shot design, chain-of-thought).
• Experience evaluating model performance, including accuracy measurement and error analysis.
• Ability to read, synthesize, and apply ML research papers.
• Statistical literacy to determine if results are meaningful or noise.
• Must be based in or be able to relocate to San Francisco, CA (strict in-person role).

Nice to have

• Experience building evaluation frameworks and benchmarking systems.
• Background in OCR, document understanding, or computer vision.
• Experience with hybrid LLM/rule-based systems.
• Familiarity with process mining or workflow analysis.
• Published research or formal research methodology training.

Culture & Benefits

• High-impact work with global Fortune 500 enterprises.
• Employer-funded healthcare benefit via Thatch ($10,000/year) and meal stipend ($220/week).
• Substantial equity ownership included in every offer.
• Ambitious, high-velocity environment focused on the craft and technical novelty.
• Equipment choice: Mac, Linux, or Windows.

Hiring process

• Resume screen.
• 1:1 interview with founder.
• Technical deep-dive into past research and evaluation work.
• Live coding exercise focusing on a real-world problem.