AI Infrastructure, Inference (AI)

Location: London, United Kingdom or Zurich, Switzerland. Employees within the specified distance of a designated Microsoft office are expected to work from that office at least four days per week from January 26, 2026, subject to local law.

Salary: CHF 183,800–309,700 gross annual base pay in Switzerland.

Company

Microsoft AI is a startup-like organization within Microsoft focused on advancing safe and responsible artificial intelligence and delivering models through major product teams.

What you will do

• Work with researchers and engineers to implement frontier AI research ideas.
• Develop systems, tools, and techniques that improve model inference performance and compute efficiency.
• Build debugging tools for performance bottlenecks, numerical instability, and distributed-systems issues.
• Establish tools and processes that improve collective engineering productivity.
• Remove technical roadblocks and deliver improvements iteratively to users.
• Contribute in a fast-paced, design-driven product development cycle.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience involving coding, or equivalent experience.
• Required coding experience may include C, C++, C#, Java, JavaScript, or Python.

Nice to have

• Master’s degree and 8+ years of technical engineering experience, or bachelor’s degree and 12+ years of experience, or equivalent experience.
• Experience with generative AI, distributed computing, and large-scale production inference.
• Expertise in Python and its ecosystem, including tools such as uv, pybind/nanobind, and FastAPI.
• Experience with GPU kernel programming.
• Experience benchmarking, profiling, and optimizing PyTorch generative AI models.
• Experience with open-source inference frameworks such as vLLM and SGLang.
• Working familiarity with the material in the JAX Scaling Book.

Culture & Benefits

• Work closely with AI researchers in a vertically integrated organization spanning kernels, architecture co-design, distributed systems, profiling, and testing tools.
• Culture emphasizes growth mindset, innovation, collaboration, respect, integrity, accountability, and inclusion.
• The role is part of a startup-like Microsoft AI organization focused on safety, responsibility, and human values.
• Certain roles may be eligible for benefits and additional compensation.

Hiring process

• The position remains open for at least five days, with applications accepted on an ongoing basis until filled.