Member Of Technical Staff – Copilot AI Evaluation Engineering Manager (AI)

TL;DR

Member of Technical Staff – Copilot AI Evaluation Engineering Manager (AI): Leading a team to build and scale LLM evaluation solutions for hirify.global Copilot with an accent on quality assurance, system performance, and agentic solution design. Focus on delivering secure, reliable, and scalable evaluation platforms while collaborating with cross-functional product and research teams.

Location: Must be based in the United States, with a hybrid office requirement (at least four days a week in the office).

Salary: $139,900 – $304,200 per year (depending on location).

Company

A global leader in technology empowering every person and organization to achieve more through innovation and inclusive AI development.

What you will do

• Hire, manage, and lead a high-performing team of software and AI engineers.
• Collaborate with leadership to prioritize features for the Copilot AI companion.
• Design and build robust evaluation platforms and novel techniques for measuring LLM quality.
• Break down complex, long-term goals into clear milestones and actionable tasks.
• Ensure technical delivery is secure, scalable, and meets high reliability standards.
• Foster an inclusive and collaborative environment, embodying company values.

Requirements

• Bachelor’s Degree in Computer Science or related technical discipline.
• 6+ years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python.
• 3+ years of people management experience.
• Experience with ML or AI evaluation techniques.
• Proven track record of leading teams in delivering large-scale software systems.
• Comfortable thriving in a fast-paced, ambiguous environment.

Culture & Benefits

• Comprehensive benefits package, including health insurance and 401(k).
• Inclusive culture emphasizing a growth mindset and accountability.
• Opportunities to solve complex AI challenges impacting millions of users.
• Support for professional development and continuous learning.
• Collaborative environment with cross-functional leadership opportunities.