Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Applied Machine Learning Engineer (AI): Building evaluation systems and feedback loops for enterprise AI agent workflows with an accent on model behavior, product quality, and real-world performance. Focus on translating qualitative user feedback into actionable model improvements and rigorous evaluation frameworks.
Company
Cohere is a leading security-first enterprise AI company building frontier foundation models and end-to-end products to solve real-world business problems.
What you will do
- Own the evaluation strategy for North, defining metrics for agent workflows, tool use, and enterprise knowledge work.
- Build high-quality evaluation systems based on user feedback, production failures, and product goals.
- Create continuous feedback loops that turn product insights into actionable model updates.
- Act as the voice of the product within the modelling team to bridge the gap between user needs and model capabilities.
- Analyze model failures and capability gaps to provide actionable recommendations for model selection and patches.
Requirements
- Must be able to collaborate effectively within Europe and East Coast North America time zones.
- Proven experience improving LLM-powered or AI-product systems through evals, feedback loops, or model adaptation.
- Strong applied MLE judgment with a focus on model behavior, eval validity, and production tradeoffs.
- Ability to translate messy qualitative signals into structured measurement.
- Self-directed and practical approach to solving open-ended technical and product problems.
Culture & Benefits
- 6 weeks of paid vacation (30 working days).
- Comprehensive health and dental benefits, including mental health support.
- Retirement savings matching (RRSP/401K/Pension).
- 100% parental leave top-up for up to 6 months.
- Annual enrichment benefits including stipends for learning, fitness, and arts.
- $500 home office setup stipend and co-working benefits for remote employees.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →