Software Engineer, Applied Evals (AI)

TL;DR

Software Engineer, Applied Evals (AI): Designing and building evaluation systems for advanced AI models with an accent on creating reliable feedback loops and improving model performance. Focus on collaborating with research and product teams to shape model interaction paradigms and ensure product quality.

Location: Hybrid (3 days in the office per week, San Francisco HQ)

Company

hirify.global is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.

What you will do

• Define core evaluation signals that drive model improvement.
• Design agents, harnesses, and eval pipelines that are reliable and extendable.
• Prototype solutions with real workflows and convert them into scalable feedback loops.
• Connect evaluation signals directly to research and training systems.
• Shape model interaction paradigms by partnering with engineering, research, and product teams.
• Build reusable systems and tools that enable contributions from across the company.

Requirements

• 4+ years of experience in software engineering with strong fundamentals.
• Experience building AI agents or applications.
• Familiarity with evaluation methods for LLMs.
• Understanding of deep learning concepts.
• Clear communication across technical and non-technical audiences.
• Motivated by high-impact collaboration and thrive in ambiguity.