Member of Technical Staff, Software Co-Design AI HPC Systems (AI)

TL;DR

Member of Technical Staff, Software Co-Design AI HPC Systems (AI): Architecting, co-designing, and productionizing next-generation AI systems at datacenter scale with an accent on optimizing end-to-end performance, efficiency, reliability, and cost across models, systems software, networking, storage, and AI hardware. Focus on deep hardware–software co-design, rigorous systems thinking, and translating insights into concrete improvements across the stack from kernels to silicon-level trade-offs.

Location: Hybrid in Redmond, United States. Employees are expected to work from a designated Microsoft office at least four days a week if living within 50 miles of the office.

Salary: USD $139,900 – $331,200 per year.

Company

hirify.global's Superintelligence Team is a startup-like team within hirify.global, aiming to develop ultra-capable, safety-aligned AI systems that amplify human potential.

What you will do

• Lead co-design of AI systems across hardware and software boundaries (accelerators, interconnects, memory, storage, runtimes, distributed training/inference).
• Drive architectural decisions by analyzing workloads, identifying bottlenecks, and translating findings into system and hardware requirements.
• Co-design and optimize parallelism strategies, execution models, and distributed algorithms for scalability, utilization, reliability, and cost efficiency.
• Develop and evaluate what-if performance models to project system behavior under future workloads and hardware generations.
• Partner with compiler, kernel, and runtime teams to unlock the full performance of current and next-generation accelerators.
• Influence and guide AI hardware design at system and silicon levels.
• Lead cross-functional efforts to prototype, validate, and productionize high-impact co-design ideas.
• Mentor senior engineers and researchers, setting technical direction and raising the bar for systems rigor.

Requirements

• Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python.
• Proficiency in systems-level programming (e.g., C/C++, CUDA, Python) and performance-critical software development.
• Strong background in one or more of the following areas: AI accelerator or GPU architectures; distributed systems and large-scale AI training/inference; high-performance computing (HPC) and collective communications; ML systems, runtimes, or compilers; performance modeling, benchmarking, and systems analysis; hardware–software co-design for AI workloads.
• Proven ability to work across organizational boundaries and influence technical decisions.
• Experience designing or operating large-scale AI clusters for training or inference.
• Deep familiarity with LLMs, multimodal models, or recommendation systems, and their systems-level implications.

Nice to have

• Master’s Degree with 8+ years experience OR Bachelor’s Degree with 12+ years experience.
• Experience with accelerator interconnects and communication stacks (e.g., NCCL, MPI, RDMA, high-speed Ethernet or InfiniBand).
• Background in performance modeling and capacity planning for future hardware generations.
• Prior experience contributing to or leading hardware roadmaps, silicon bring-up, or platform architecture reviews.
• Publications, patents, or open-source contributions in systems, architecture, or ML systems.

Culture & Benefits

• Part of a startup-like team inside hirify.global, pushing the boundaries of AI towards Humanist Superintelligence.
• Focus on a growth mindset, innovation, and collaboration to achieve shared goals.
• Commitment to values of respect, integrity, and accountability to create a culture of inclusion.
• Mission to deliver breakthroughs that benefit society, advancing science, education, and global well-being.
• Opportunity to partner with product teams reaching billions of users for immense positive impact.