Model Quality Software Engineer (AI)

TL;DR

Model Quality Software Engineer (AI): Building and optimizing systems to improve Claude’s coding capabilities, focusing on tooling, infrastructure, and evaluations. Focus on designing robust eval systems, developing data pipelines, and creating internal tools to accelerate AI research.

Location: Requires presence in San Francisco, CA or New York, NY. This is a hybrid role, expecting all staff to be in one of our offices at least 25% of the time. Visa sponsorship is available.

Salary: $320,000 - $485,000 USD

Company

hirify.global is a public benefit corporation focused on creating reliable, interpretable, and steerable AI systems.

What you will do

• Design and build evaluation systems that measure model capabilities across diverse coding tasks.
• Develop tooling and infrastructure to enable researchers to run experiments at scale.
• Create pipelines for data collection, processing, and analysis.
• Build internal tools that improve researcher productivity and accelerate iteration cycles.
• Serve as a bridge between product and research, translating research questions into engineering solutions.
• Own systems end-to-end, from design through production reliability.

Requirements

• Experience building and owning complex systems (pipelines, infrastructure, orchestrating components).
• Ability to thrive in high-intensity, fast-paced environments.
• Strong ownership of problems and independent drive to completion.
• Power user of agentic coding tools with strong intuition about model capabilities and limitations.
• Comfortable diving into unfamiliar technical domains and figuring things out quickly.
• Deep care about correctness and reliability in the systems you build.
• Excitement to work at the boundary between engineering and AI research.
• At least 5 years of work experience required.
• Bachelor's degree in a related field or equivalent experience required.

Nice to have

• Experience writing or maintaining evaluation frameworks.
• Experience with Reinforcement Learning systems.
• Background in high-performance, demanding environments.
• Research computing or scientific infrastructure background.
• Strong quantitative foundation (math, physics, or related fields).
• Proficiency in Python and TypeScript.

Culture & Benefits

• Work as a single cohesive team on large-scale AI research efforts.
• Value impact, advancing long-term goals of steerable, trustworthy AI.
• Collaborative group with frequent research discussions.
• Offer competitive compensation and benefits.
• Optional equity donation matching, generous vacation, and parental leave.
• Flexible working hours and lovely office space for collaboration.