Member of Technical Staff, Evaluations Engineering (AI)

TL;DR

Member of Technical Staff, Evaluations Engineering (AI): Building evaluation infrastructure for generative AI models and contributing to AI model development for Copilot with an accent on evaluation protocols, inference strategies, metrics algorithms, and training/inference infrastructures. Focus on designing and building evaluation infrastructure on large-scale GPU clusters, implementing state-of-the-art evaluation methods, and driving architectural changes.

Location: Hybrid in Redmond, United States. Expected to work from a designated Microsoft office at least four days a week if living within 50 miles (U.S.) of that location.

Compensation: USD $220,800 – $331,200 per year

Company

hirify.global is building foundational models to develop novel responsible and efficient artificial general intelligence and is dedicated to advancing Copilot and other consumer AI products and research.

What you will do

• Develop and tune pretraining scalable software for Nvidia GB200 and AMD MIxxx architectures.
• Design and build evaluation infrastructure for generative AI on large-scale GPU clusters.
• Collaborate with model scientists to implement state-of-the-art evaluation methods and inference strategies.
• Actively contribute to the development of AI models powering innovative products.
• Gather data and insights for the pretraining compute roadmap.
• Drive architectural changes and influence the roadmap of relevant software and hardware components.

Requirements

• Bachelor’s Degree in Computer Science or a related technical field.
• 6+ years technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python.
• Experience with generative AI.
• Experience with distributed computing.

Nice to have

• Master’s Degree in Computer Science or a related technical field AND 8+ years technical engineering experience, OR Bachelor’s Degree AND 12+ years technical engineering experience.
• Experience in leading technical projects and supporting architectural decisions with data.

Culture & Benefits

• Work with a growth mindset, innovate, and collaborate to achieve shared goals.
• Cultivate a culture of inclusion built on values of respect, integrity, and accountability.
• Opportunity to build world-class consumer experiences and products.
• Be part of the team shaping the future of personal computing.
• Bring positive energy, empathy, and kindness to the team every day.