Proctor Quality and Learning Manager, Scaling Operations (EdTech)

Location: London, England

Salary: £90,630–£122,617 GBP per year, plus equity compensation

Company

hirify.global develops education products and operates the hirify.global English Test, a high-stakes assessment used by institutions worldwide.

What you will do

• Own the proctoring quality standard, including rubrics, decision rules, examples, and guidance for routine and complex cases.
• Lead recurring proctor certification, calibration, and adjudication cycles; resolve disputed decisions and maintain consistent, auditable outcomes.
• Build onboarding, certification, ongoing training, remediation, and monthly learning interventions for the proctoring organization.
• Analyze audits, calibration results, disagreement patterns, and performance trends to measure effectiveness and identify quality improvements.
• Guide Training Specialists and adjudicators by setting expectations, assigning deliverables, reviewing outputs, and supporting onboarding.
• Partner with Psychometrics, Security, Operations, Product, and Engineering to validate human and AI-assisted workflows and respond to evolving threats.

Requirements

• 5+ years of experience in assessment development, scoring or rater quality, certification, quality assurance, or another field involving complex judgments.
• Experience aligning reviewers to shared standards through calibration programs and running adult-learning programs beyond one-off materials.
• Strong judgment in ambiguous cases, attention to detail, and the ability to create clear, defensible guidance.
• Analytical ability to interpret quality data, disagreement patterns, and performance trends and turn them into practical interventions.
• Experience leading cross-functionally without formal authority, including directing contractors or partners.
• Experience designing quality standards, rubrics, audit controls, and benchmarks for human–technology workflows, including AI-assisted processes.

Nice to have

• Experience in language assessment, test security, remote proctoring, trust and safety, or fraud prevention.
• Experience maintaining quality across large, distributed examiner, rater, reviewer, or contractor populations.
• Familiarity with inter-rater agreement, reliability, standardization, performance monitoring, learning-management systems, assessment platforms, or operational analytics.

Culture & Benefits

• Work on education products used by hundreds of millions of learners worldwide.
• Collaborate across Psychometrics, Security, Operations, Product, and Engineering.
• Access employee benefits supporting holistic well-being.
• Work in an environment focused on experimentation, fact-based decisions, learning, and innovative solutions to complex problems.