Member of Technical Staff – Copilot AI Evaluation Engineering Manager (AI)

TL;DR

Member of Technical Staff – Copilot AI Evaluation Engineering Manager (AI/ML): Leading a team to design and build world-class LLM evaluation solutions for Copilot with an accent on secure, reliable, and scalable evaluation platforms. Focus on measuring and improving Copilot quality, driving feature implementation, and coordinating cross-team efforts.

Location: Mountain View, United States (Hybrid). Employees living within 50 miles of a Microsoft office in the U.S. are expected to work from the office at least four days a week.

Salary: USD $139,900 – $274,800 per year

Company

hirify.global is a team within Microsoft focused on building systems with true artificial intelligence across agents, applications, services, and infrastructure, aiming to make AI accessible to all.

What you will do

• Hire, manage, and lead a team of software engineers, AI engineers, and machine learning engineers.
• Collaborate with Engineering and Product leadership to prioritize features.
• Design and build evaluation platforms, novel evaluation techniques, and agentic solutions for Copilot.
• Drive implementation of features and systems, breaking down long-term goals into clear milestones.

Requirements

• Bachelor’s Degree in Computer Science or related technical discipline.
• 6+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python.
• 3+ years people management experience.
• Hands-on experience with ML and/or AI evaluation.
• Experience leading engineering teams to deliver large-scale software systems in AI, machine learning, or related fields.

Culture & Benefits

• Work in a deeply iterative, collaborative, fast-paced environment.
• Opportunity to work on interesting and challenging AI questions.
• Embody a growth mindset, innovate to empower others, and collaborate on shared goals.
• Culture of inclusion built on values of respect, integrity, and accountability.
• Specific benefits information available via Microsoft Careers link.