Software Engineer (AI Infra)

Location: Mountain View, United States. Starting January 26, 2026, employees living within 50 miles of a designated U.S. Microsoft office are expected to work from that office at least four days per week.

Salary: USD $119,800–$234,700 per year for Software Engineering IC4 across the U.S.; higher ranges apply to IC4 and IC5 roles in the San Francisco Bay Area and New York City metropolitan area.

Company

Microsoft AI develops advanced AI systems designed to amplify human potential while remaining controllable, safety-aligned, and grounded in human values.

What you will do

• Develop pre-training and post-training infrastructure for large language models.
• Build benchmarking, evaluation, router, and backend systems.
• Contribute to model architecture, data curation, training and inference infrastructure, alignment, and RLHF.
• Gather data and insights to shape the LLM training compute roadmap.
• Work across engineering and research to deliver AI capabilities iteratively to users.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience, or equivalent experience.
• Professional coding experience with C, C++, C#, Java, JavaScript, Python, or comparable languages.
• Ability to work in a fast-paced, design-driven product development environment.
• For employees living within 50 miles of a designated U.S. office, at least four days per week in the office is expected.

Nice to have

• Master’s degree and 6+ years of technical engineering experience, or bachelor’s degree and 8+ years of experience.
• Experience with generative AI and distributed computing.
• Experience leading technical projects and supporting architecture decisions with data.

Culture & Benefits

• Collaborative culture centered on respect, integrity, accountability, inclusion, and continuous growth.
• Opportunity to work on AI models that can reach billions of users through Microsoft product teams.
• Eligible roles may include benefits and additional compensation.