9 часов назад
Research Engineer (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Research Engineer (AI) (LLM agents and evaluation): Building the outer-loop systems that orchestrate AI coding agents, evaluate their performance, and turn production traces into reusable datasets and improvements with an accent on agent harnesses, evaluation methodology, and failure-mode analysis. Focus on designing experiments from real customer workflows, building evaluation and data pipelines, analyzing agent traces, and shipping measurable improvements to agent performance.
Location: Hybrid from the London office, with Monday, Tuesday, and Thursday as the primary in-office days
Company
is a fast-growing Series A startup building a context layer for AI coding agents and a platform for AI-native software development.
What you will do
- Design agent harnesses that combine tools, context, and control flow to improve coding-agent behavior.
- Develop task- and repository-level evaluation methods, datasets, runners, and analysis workflows.
- Build outer-loop pipelines that turn production traces and failures into reusable test cases and improvement signals.
- Analyze agent traces at scale, identify actionable failure modes, and communicate findings to engineering.
- Work directly with customers by joining calls, observing sessions, and using real workflows to shape research priorities.
- Partner with engineering, product, and design to turn research experiments into shipped improvements.
Requirements
- 4+ years of experience shipping AI/ML products in a startup or applied industry setting.
- Recent hands-on experience with LLMs and agentic systems.
- Deep expertise in at least one area: agent orchestration, agentic evaluation, outer-loop optimization and pipelines, or failure-mode analysis.
- Experience building evaluation or training datasets and the supporting pipelines.
- Strong product and customer instincts, with sound judgment about benchmarks, prototypes, and evaluation methods.
- Master’s or PhD in a relevant computational field.
Nice to have
- Direct experience with coding agents or code-generation systems.
- Experience with reinforcement learning, bandits, or other outer-loop optimization frameworks applied to LLMs.
- Experience building synthetic data, dataset infrastructure, or internal tooling used by engineers.
- A project to share, such as a GitHub repository.
Culture & Benefits
- Competitive salary commensurate with experience.
- Health insurance extending to partners and dependents.
- Pension contributions.
- Pet-friendly office near King’s Cross with regular team lunches, drinks, and socials.
- Warm, inclusive environment with a strong focus on diversity and welcoming underrepresented groups in tech.
Hiring process
- Introductory call followed by a conversation with the AI Research Lead.
- Four-hour technical take-home exercise extending a one-shot implementation.
- Half-day onsite session with whiteboarding and hands-on activities, followed by leadership conversations.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →