Senior Product Engineer (Agent Training and Evals)

Location: Remote, UK

Company

hirify.global provides human data infrastructure that connects researchers and companies with participants to support AI development and evaluation.

What you will do

• Build scalable tooling for capturing and processing data from AI agents and humans performing real-world tasks.
• Design infrastructure for evaluating AI agents in safe and secure environments.
• Solve complex problems involving compute, orchestration, scaling, security, and reliability.
• Develop approaches for training, benchmarking, and evaluating AI agents.
• Make pragmatic technical decisions in an ambiguous 0→1 environment.
• Partner with product engineering and AI research to turn customer problems into working products.

Requirements

• Strong experience building scalable cloud infrastructure or distributed systems.
• Solid understanding of system deployment, scaling, and security.
• Hands-on experience integrating and evaluating AI models or agents.
• Interest in how AI agents are trained, evaluated, and improved.
• Strong product mindset, communication, collaboration, and ability to work with ambiguity.
• Experience with Google Cloud Platform, Python, JavaScript or TypeScript, FastAPI, Vue.js, Postgres, Kubernetes, and monitoring or deployment tooling is relevant to the role; Python is useful but not essential.

Nice to have

• Experience with image, video, or audio processing.

Culture & Benefits

• Remote working within a mission-driven AI company.
• Opportunity to work with a human data platform and emerging agentic AI technologies.
• Competitive salary and benefits.
• High-ownership, cross-functional work with direct product impact.