Member Of Technical Staff Software Engineer AI Infra (AI)

TL;DR

Member Of Technical Staff Software Engineer AI Infra (AI): Develop and optimize AI infrastructure software for large-scale GPU clusters powering generative AI models like Copilot. With an accent on scalable pretraining software, evaluation infrastructure, and performance benchmarking. Focus on designing reliable, high-performance systems for AI model training and inference on cutting-edge hardware.

Location: Mountain View, United States, onsite with expectation to work from office at least four days a week if living within 50 miles

Salary: $158,400–$258,000 per year (San Francisco Bay area and New York City metropolitan area range)

Company

hirify.global is a division dedicated to advancing AI products and research, including Copilot, Bing, Edge, and generative AI, with a mission to create responsible and efficient artificial general intelligence.

What you will do

• Develop and tune scalable pretraining software for Nvidia GB200 and AMD MIxxx GPU architectures.
• Benchmark and analyze GPU cluster performance to inform compute roadmap.
• Collaborate with model scientists to implement evaluation methods and inference strategies.
• Design and build evaluation infrastructure for generative AI on large-scale GPU clusters.
• Drive architectural improvements and influence software and hardware roadmaps.
• Work in a fast-paced, design-driven product development environment focused on AI innovation.

Requirements

• Location: Must be based in or near Mountain View, United States with onsite work expectation
• Bachelor’s degree in Computer Science or related field with 2+ years engineering experience or equivalent.
• Proficiency in programming languages such as C, C++, C#, Java, JavaScript, or Python.
• Experience or strong interest in generative AI and distributed computing.
• Ability to lead technical projects and support architectural decisions with data.
• English: Job posting in English, minimum B2 level assumed

Nice to have

• Master’s degree or higher with additional years of experience.
• Experience with large-scale GPU cluster benchmarking and tuning.

Culture & Benefits

• Work within a startup-like team inside hirify.global focused on humanist superintelligence.
• Collaborate with product teams impacting billions of users worldwide.
• Embody values of respect, integrity, accountability, and inclusion.
• Opportunity to work on cutting-edge AI research and products.
• Onsite work with local law compliance and flexible arrangements.