Director of Engineering, IAEF (AI Evaluation)

Location: Remote-first, based in the US or EU; New York or the San Francisco Bay Area is strongly preferred for quarterly in-person meetings. Travel is approximately 15%.

Salary: $215,000–$315,000 annually, commensurate with experience.

Company

hirify.global supports education, digital equity, community leadership, and opportunity through mission-driven projects, including the fiscally sponsored Independent AI Evaluation Foundation.

What you will do

• Own the Workbench Design–Test–Analyze–Publish workflow, Component Contract, Artifacts API, component registry, and canvas interface.
• Build persistent, structured evaluation history and integrate red-teaming, administrative dashboard, and human-in-the-loop data-capture systems.
• Lead engineering planning, hiring, development, retention, code review, on-call, incident response, and roadmap practices.
• Translate human-in-the-loop red teaming, automated benchmarks, LLM-as-judge systems, and drift detection into a reusable evaluation platform.
• Lead vendor risk reviews and coordinate security, compliance, data, intellectual property, and nonprofit/PBC resource separation.
• Represent IAEF with customers, partners, funders, and press, and lead technical fundraising and developer-relations materials.

Requirements

• 12+ years of software engineering experience, including at least four years in senior technical leadership.
• Experience building and operating plugin, extension, or component-based platforms and production AI evaluation, red-teaming, machine-learning observability, or model-testing systems.
• Experience hiring and retaining senior engineers in a distributed team, including an applied machine-learning or agentic-systems specialist.
• Ability to design reusable platform components and work with human-in-the-loop transcripts, benchmark scores, and LLM red-teaming results.
• Ability to communicate technical decisions to security leaders, funders, investors, customers, and partners.
• Must be based in the US or EU and able to travel approximately 15%; quarterly in-person meetings are expected, with New York or the San Francisco Bay Area strongly preferred.

Nice to have

• Prior CTO, VP Engineering, or founding-engineer experience at an early-stage, institutionally funded company.
• Experience enabling external developers to build on a platform and working with academic or civil-society evaluation partners.
• Experience implementing ISO 42001, the NIST AI Risk Management Framework, or SOC 2 requirements.

Culture & Benefits

• Full-time remote-first work with virtual interviews and distributed engineering collaboration.
• Health, dental, and vision insurance, with employee premiums fully covered and dependent premiums 85% covered.
• HSA employer contributions, FSA, disability, life, accidental death and dismemberment, and wellness benefits.
• 401(k) plan with a 6% employer match.
• Paid time off, 16 paid holidays, bereavement leave, and paid parental leave.

Hiring process

• Submit a resume and a cover letter outlining qualifications.
• Interviews are conducted virtually.