8 дней назад
Senior AI Engineer (LLM Agents)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior AI Engineer (LLM Agents): Improving chat and voice agents for field sales with an accent on prompting, context orchestration, model benchmarking, and evaluation pipelines. Focus on building agent harnesses, converting real conversations into test cases, and measuring quality, latency, and cost improvements across model and prompt changes.
Location: Munich, Germany; hybrid work from the Munich office or remote work is available.
Company
builds an AI assistant for field sales that documents customer interactions through chat and voice agents.
What you will do
- Map ’s chat and voice agents end to end and identify the most significant failure modes.
- Improve agent behavior by working across prompts, tools, context, and model selection.
- Build evaluation sets, metrics, LLM judges, and benchmarks for key customer use cases.
- Benchmark models for quality, latency, and cost, then ship measurable improvements against a baseline.
- Run evaluations for prompt, model, and harness changes and turn real conversations into new test cases.
- Partner with backend engineers to establish the long-term roadmap for agent quality.
Requirements
- Senior-level experience owning and shipping LLM agents to real users.
- Evidence of improving agent quality with data and measurable results.
- Strong Python skills and the ability to debug agent behavior across prompts, tools, context, and models.
- Hands-on experience with evaluation pipelines, LLM judges, model benchmarks, and statistics.
- Ability to analyze raw conversations and convert findings into test cases, fixes, and priorities.
- Full-time availability; hybrid work in Munich is preferred, with remote work also available.
Nice to have
- Experience with current agent frameworks, realtime voice agents, or multilingual agents.
- Familiarity with AI coding tools.
- Technical degree from a major technical university.
Culture & Benefits
- Small team of specialized engineers with strong ownership of the core agents.
- Outcome-focused hybrid setup with an office near Frauenkirche in Munich.
- 30 days of paid time off.
- Strong base salary with meaningful equity ownership.
- Free meals and drinks, Deutschlandticket, high-quality equipment, and Wellpass.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
ClickHouse
10 дней назад
Product Engineer (LLM)
90 000 - 160 000€
ClickHouse
13 дней назад
AI Integrations Engineer (LLM)
90 000 - 160 000€
13 дней назад
Senior Backend Engineer (AI)
ClickHouse
9 дней назад
AI Product Engineer (AI)
90 000 - 135 000GBP
14 дней назад
Staff Product Engineer (AI)
13 дней назад