Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Applied AI Lead, Health (LLM Evaluation and Orchestration): Building Copilot Health and health-domain AI systems with an accent on LLM evaluations, agentic orchestration, prompt and context engineering, tool use, and retrieval. Focus on leading engineers, designing safety and utility benchmarks, translating research into production products, and improving evaluation tooling and data pipelines.
Location: London, United Kingdom
Salary: £93,500–£161,800 per year
Company
Microsoft AI develops AI models and services, including health-focused products designed to provide useful, trusted and safe information.
What you will do
- Lead, mentor and develop a team of Applied AI Engineers while remaining hands-on with complex technical challenges.
- Set technical direction for Copilot Health and co-own the product and engineering roadmap from 0 to 1.
- Design and oversee LLM evaluation systems covering accuracy, safety, utility, benchmarking and regression testing in the health domain.
- Architect reliable agentic, multi-step LLM systems using prompt and context engineering, tool use and retrieval.
- Run experiments, interpret results and translate research findings into product improvements.
- Improve evaluation tooling, dataset pipelines, sourcing, curation and synthesis at scale.
Requirements
- Bachelor’s degree or higher in Computer Science or a related technical discipline.
- Significant Python programming experience and machine learning research experience.
- Strong hands-on experience designing, building and running LLM evaluation pipelines and automated analyses.
- Strong experience with LLM orchestration, including prompt and context engineering, harness engineering, tool use, retrieval and agentic systems.
- 8+ years of software engineering experience, including at least 3 years leading technical teams or projects.
- Experience delivering high-quality products in ambiguous, cross-functional environments with a bias toward shipping and learning.
Nice to have
- Healthcare technology or health-domain experience.
- Data engineering experience with large-scale text dataset sourcing, curation and processing.
- Experience translating cutting-edge research into shipped products in a fast-paced, startup-like environment.
- Experience with conversational AI deployment and strong written and verbal communication skills.
Culture & Benefits
- Collaborative, inclusive and high-performing engineering environment.
- Opportunities to mentor engineers and contribute to knowledge sharing and professional growth.
- Benefits and additional compensation may be available depending on the role.
- Equal opportunity employment and reasonable accommodations during the application process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
2 дня назад
Software Engineer, Health (AI)
93 500 - 161 800GBP
2 дня назад
Global AI/ML Engineer Senior Manager
173 000 - 211 000$
2 дня назад
Principal AI Evaluations Platform Engineer
183 800 - 309 700CHF
Anthropic
5 дней назад
Applied AI Architect, Startups
165 000 - 190 000GBP
5 дней назад
AI Engineer
7 дней назад