AI Engineer (Engineering AGI)

TL;DR

AI Engineer (Engineering AGI): Develop and manage evaluation benchmarks to ensure the AI engineer Archie learns and retains engineering skills, with an accent on test suite construction, metric design, and AI system quality assurance. Focus on designing automated tests, benchmarking AI performance, and detecting quality challenges such as hallucinations and regressions.

Location: Remote within the US or Canada with existing work authorization, with quarterly onsite weeks in San Mateo Bay Area; relocation to Bay Area supported

Salary: $170,000–$200,000 plus equity

Company

hirify.global is an early-stage startup building an engineering AGI focused on applying AI to physical product domains and industrial engineering.

What you will do

• Implement and operate systems for organizing, running, grading, and reporting on evaluation benchmarks.
• Design and execute QA processes for evals with input from engineering experts and industrial partners.
• Ensure evals integrate effectively with CI/CD systems and benchmark AI platform performance.
• Create methods to detect AI quality issues such as hallucinations and regressions.
• Lead technical implementation and organization of automated tests across technology stacks.

Requirements

• Must be based in the US or Canada with existing work authorization
• Experience building comprehensive test suites for software and/or AI systems.
• Experience designing evaluation metrics and visualizing system performance.
• Proficiency in Python and modern software development tools (Git, CI/CD).
• Strong communication skills with diverse stakeholders including AI researchers and domain experts.
• Ability to thrive in a fast-paced startup environment.

Nice to have

• Experience developing and running evals against LLM-based systems.

Culture & Benefits

• Mission-driven with focus on speed and intellectual excellence.
• Significant equity ownership and founder-mode culture.
• Healthcare, dental, and vision insurance.
• 401k with employer matching.
• Unlimited paid time off.
• Quarterly onsite collaboration weeks and occasional team workshops.

Hiring process

• Initial screening call (30 minutes).
• Biographical and behavioral interview (45 minutes).
• Technical interview (75 minutes).
• CEO interview (30 minutes).