Member of Technical Staff, Software Engineer AI Infra (AI)

TL;DR

Member of Technical Staff, Software Engineer AI Infra (AI): Building and optimizing scalable software for generative AI models and their evaluation infrastructure on large-scale GPU clusters with an accent on model architecture, data curation, training/inference infrastructures, and evaluation protocols. Focus on implementing state-of-the-art evaluation methods, inference strategies, and metrics algorithms for supercomputers, and driving architectural changes.

Location: Hybrid, based in New York, United States. Employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles of that location.

Salary: USD $131,400–$215,400 per year (New York City metropolitan area) for IC3, or USD $158,400–$258,000 per year (New York City metropolitan area) for IC4.

Company

hirify.global is a newly formed organization dedicated to advancing Copilot and other consumer AI products and research, building foundational models for responsible and efficient artificial general intelligence.

What you will do

• Develop and tune scalable software for Nvidia GB200 and AMD MIxxx architectures.
• Benchmark GB200 and AMD MIxxx GPU clusters.
• Gather data and insights to develop the pretraining compute roadmap.
• Actively contribute to the development of AI models for innovative products.
• Design and build evaluation infrastructure for generative AI on large-scale GPU clusters.
• Collaborate with model scientists to implement state-of-the-art evaluation methods, inference strategies, and metrics algorithms.

Requirements

• Bachelor’s Degree in Computer Science or related technical field and 2+ years of technical engineering experience.
• Proficiency in coding languages including C, C++, C#, Java, JavaScript, or Python.
• English: B2 required.
• Must be authorized to work in the United States.
• Expected to work from a Microsoft office in New York at least four days a week.

Nice to have

• Master’s Degree and 3+ years, or Bachelor's Degree and 5+ years, of technical engineering experience.
• Experience with generative AI.
• Experience with distributed computing.
• Experience in leading technical projects and supporting architectural decisions with data.

Culture & Benefits

• Be part of a startup-like team pushing the boundaries of AI toward Humanist Superintelligence.
• Opportunity to partner with product teams to reach billions of users.
• Emphasis on growth mindset, innovation, collaboration, respect, integrity, and accountability.
• Hybrid work model with office presence required four days a week if within 50 miles of a US office.
• Access to comprehensive benefits and other compensation for eligible roles.