Director, Agentforce Engineering (AI)

TL;DR

Director, Agentforce Engineering (AI): Leading the engineering of a scalable evaluation platform for AI agents, focusing on measuring performance and accuracy in production. Focus on operationalizing applied science, building custom benchmarks, and managing real-world constraints like token budgets and inference latency.

Location: San Francisco, Palo Alto, or Bellevue (USA)

Company

hirify.global is the Customer Company, inspiring the future of business with AI + Data + CRM.

What you will do

• Lead the engineering of a scalable evaluation platform for AI agents that runs in parallel with agent execution.
• Operationalize applied science by turning theoretical benchmarks into production regression tests.
• Deliver features that measure performance and accuracy of AI Agents.
• Provide technical leadership, process management, and maintain a good discipline of high quality code delivery aided with AI tools.
• Provide technical guidance, career development, and mentoring to team members.

Requirements

• Specialized Agent Evaluation Experience: You have specific experience building evaluation harnesses for LLMs or Agents
• Applied Science & Engineering Hybrid: You have a track record of managing "Research Engineering" or "Applied Science" teams where you had to operationalize vague scientific goals into shipping code.
• Deep Knowledge of Eval Methodologies: You are fluent in modern evaluation techniques, including LLM-as-a-Judge and Behavioral Analysis.
• Production-Grade AI Experience: You have shipped AI products where you had to manage real-world constraints like token budgets, inference latency, and cost-normalized accuracy.
• Experience building simulation environments to stress-test agents safely before deployment.
• Advanced degree in Computer Science, Machine Learning, or related field with a focus on system evaluation or reliability.

Culture & Benefits

• Leading with core values, hirify.global helps companies across every industry blaze new trails and connect with customers in a whole new way.
• Empowering you to be a Trailblazer – driving your performance and career growth, charting new paths, and improving the state of the world.