Senior AI Reliability Engineer (Platform)

TL;DR

Senior AI Reliability Engineer (Platform): Building and scaling evaluation frameworks, observability, and guardrails for AI-enabled workflows with an accent on reliability, safety, and performance metrics. Focus on designing automated testing pipelines, managing multi-agent system governance, and ensuring production-grade trust in AI systems within a healthcare context.

Location: Must be based in or able to work from the London office

Company

hirify.global is a healthtech company using data to power smarter cancer care and transform real-world evidence into a connected oncology ecosystem.

What you will do

• Design and improve evaluation frameworks, benchmarks, and automated testing pipelines for AI and LLM-powered workflows.
• Define and monitor quality, reliability, and safety metrics, including drift detection and hallucination risk.
• Develop reliability practices such as SLOs, SLIs, incident response, and root-cause analysis for AI systems.
• Orchestrate governance and guardrails for multi-agent systems, including auditability and human-in-the-loop controls.
• Partner with cross-functional teams to guide AI adoption decisions and build-vs-buy strategies.
• Participate in on-call rotations and support experimentation with emerging AI technologies.

Requirements

• 5+ years of experience in platform engineering, SRE, MLOps, or related technical fields.
• Strong Python skills and experience building production-quality systems.
• Experience designing evaluation frameworks, statistical analyses, and quality metrics for ML/AI systems.
• Deep understanding of AI reliability, observability, logging, tracing, and drift detection.
• Proficiency with modern cloud infrastructure including AWS, containers, and Kubernetes.
• Fluent in English.

Nice to have

• Experience with LLM evaluation, red-teaming, AI safety, and RAG evaluation.
• Hands-on experience with tools like Datadog, OpenTelemetry, Airflow, or Ray.
• Background in healthcare, life sciences, or other regulated, privacy-sensitive environments.

Culture & Benefits

• Focus on fostering a culture of confidence, compassion, and clarity.
• Opportunity to work on high-impact projects that improve cancer care outcomes.
• Multidisciplinary environment collaborating with oncologists, data scientists, and engineers.
• Commitment to professional growth and pragmatic, scalable decision-making.