Member of Technical Staff, Software Engineer AI Infra (Generative AI)

TL;DR

Member of Technical Staff, Software Engineer AI Infra (Generative AI): Designing and building evaluation infrastructure for generative AI on large-scale GPU clusters with an accent on reliability, performance, and health of hundreds of nodes. Focus on implementing state-of-the-art evaluation methods, inference strategies, and metrics algorithms for efficient execution of evaluation workloads.

Location: Redmond, United States. Expected to work from a designated Microsoft office at least four days a week if residing within 50 miles of the location.

Salary: USD $100,600 – $258,000 per year.

Company

hirify.global is building foundational models to develop novel responsible and efficient artificial general intelligence, with the Superintelligence Team focusing on Humanist Superintelligence.

What you will do

• Develop and tune scalable software for Nvidia GB200 and AMD MIxxx architectures.
• Benchmark GPU clusters and gather insights to develop the pretraining compute roadmap.
• Actively contribute to the development of AI models that are powering innovative products.
• Design and build evaluation infrastructure for generative AI on large-scale GPU clusters.
• Collaborate closely with model scientists to implement state-of-the-art evaluation methods, inference strategies, and metrics algorithms.
• Drive architectural changes and influence the roadmap of relevant software and hardware components.

Requirements

• Bachelor’s Degree in Computer Science or a related technical field.
• 2+ years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python.
• Must be based in the United States.
• Valid US work authorization is required.
• English: B2 required.

Nice to have

• Master’s Degree in Computer Science or related technical field AND 3+ years experience, OR Bachelor’s Degree and 5+ years experience.
• Experience with generative AI.
• Experience with distributed computing.
• Experience in leading technical projects and supporting architectural decisions with data.

Culture & Benefits

• Emphasis on bringing positive energy, empathy, and kindness to the team.
• Fostering a growth mindset, innovation, and collaboration.
• Building a culture of inclusion, respect, integrity, and accountability.
• Opportunity to shape the future of personal computing and amplify human potential.
• Working on groundbreaking AI models that reach billions of users.
• Eligible for benefits and other compensation (details available on Microsoft Careers).