Applied AI Engineer, Health

Location: London, United Kingdom

Salary: £93,500–£161,800 per year

Company

Microsoft AI develops AI models and services, including Copilot products for health and wellbeing use cases.

What you will do

• Design and build evaluation systems for LLM capabilities in healthcare.
• Build evaluation pipelines, curate and synthesize datasets, and develop automated analyses.
• Run experiments on prompting techniques using internal and industry benchmarks.
• Improve internal tooling for implementing, running, and analyzing evaluations.
• Build benchmarking and regression-testing capabilities covering model accuracy, safety, and utility.
• Collaborate with product teams to translate research into benchmarks and product roadmaps.

Requirements

• Bachelor’s or higher degree in Computer Science or a related technical discipline.
• Significant Python programming experience or machine learning research experience.
• Experience building with and around LLMs, including prompt, context, and harness engineering.
• Deep expertise in evaluating and understanding agent performance.
• Experience working cross-functionally and delivering high-quality results in ambiguous environments.
• Experience taking products or capabilities from 0 to 1 with a bias toward shipping and learning.

Nice to have

• Experience in healthcare technology or the health domain.
• Experience sourcing, curating, and processing text datasets at scale.
• Strong written and verbal communication skills.
• Interest in emerging AI technologies, patterns, and best practices.

Culture & Benefits

• Cross-functional collaboration with product managers, designers, researchers, and engineers.
• Inclusive work environment focused on knowledge sharing and professional growth.
• Benefits and additional compensation may be available depending on the role.