Backend Software Engineer (AGI Safety)

TL;DR

Backend Software Engineer (AGI Safety): Building and maintaining backend tools and services for frontier AGI safety research, including evals libraries, monitoring LLM traffic, and automation pipelines. Focus on designing scalable evaluation orchestration, telemetry, and data warehousing systems to support advanced AI research workflows.

What you will do

• Develop internal tooling for running and analyzing large-scale agentic evaluations.
• Build automated evaluation pipelines to accelerate pre-deployment testing of new models.
• Create orchestration tools for secure, reliable parallel evaluation on remote machines.
• Implement LLM proxy services to monitor and control coding agent traffic in real time.
• Optimize CI pipelines to reduce execution time and improve test reliability.
• Design telemetry APIs and data warehousing services for monitoring and dataset creation.

Requirements

• English: B2 level or higher required
• Experience with backend development and automation pipelines.
• Familiarity with AI/LLM technologies and tooling is highly relevant.