Associate Director, AI Performance (AI)

TL;DR

Associate Director, AI Performance (AI): Define and drive standards for AI performance, safety, and financial impact across a customer-facing AI portfolio with an accent on experimentation measurement, AI risk guardrails, and multi-agent AI monitoring. Focus on building observability and control frameworks that improve transparency, responsible delivery, and measurable customer and business outcomes.

Location: NSW (Brisbane, Melbourne, or Sydney)

Company

hirify.global is an Australian telecommunications company delivering mobile, broadband, and digital solutions to millions of customers.

What you will do

• Lead the definition, testing, and measurement standards for AI performance and experimentation.
• Ensure accurate financial impact measurement for reporting and portfolio decision-making.
• Implement and maintain AI risk guardrails, controls, and operational intelligence aligned to Responsible AI frameworks.
• Diagnose and solve complex AI monitoring challenges across multi-agent systems.
• Partner with Product Directors, Business Ops, Engineering, Finance, and Risk to maximize customer and financial outcomes.
• Drive adoption of experimentation frameworks and next-generation AI monitoring tools, championing transparency and continuous improvement.

Requirements

• Strong experience measuring quantitative or generative AI performance and financial impact (experience in high-impact environments like quantitative trading is preferred).
• Mathematics, statistical physics, or data science background; PhD preferred.
• Demonstratable experience building models and observability solutions on cloud platforms.
• Proven ability to measure risk and implement AI controls.
• Influential leadership experience driving strategy and alignment across stakeholders.
• Comfort navigating complexity and solving novel AI monitoring challenges.

Culture & Benefits

• Flexible working: opportunities to work three days in the office and two days remote or from home.
• Competitive remuneration, employee discounts, and a monthly $80 credit plus discounts with retail partners.
• Competitive leave policies including additional “Connected” days and paid parental leave up to 16 weeks.
• Development support via hirify.global U micro-credentials developed with La Trobe and Macquarie Universities.
• Wellbeing support with free access to counselling and support services 24/7.