Principal Software Engineer (AI)

TL;DR

Principal Software Engineer (AI): Designing and building next-generation Ads products that drive revenue growth and create innovative advertising experiences. Focus on evolving the core capabilities of ad-serving infrastructure and shaping new monetization capabilities and the next generation of model serving infrastructure that powers them.

Location: Must live within a 50-mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location and be expected to work from the office at least four days per week.

Salary: USD $163,000 – $296,400 per year.

Company

Microsoft’s mission is to empower every person and every organization on the planet to achieve more.

What you will do

• Design and build new Ads products and monetization capabilities that unlock incremental revenue and enhance advertiser and end-user experiences.
• Lead the development of large-scale, distributed online serving systems to process millions of ad requests per second.
• Architect and evolve ML-powered ranking and inference platforms across CPU and accelerator-based environments.
• Optimize end-to-end performance across model serving, batching, caching, scheduling, and traffic management to improve latency and cost efficiency.
• Drive system-level performance tuning using profiling, instrumentation, and production telemetry—improving tail latency and resource utilization.
• Collaborate with product and data science teams to translate business goals into scalable technical architecture.

Requirements

• Bachelor’s Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python.
• Must live within a 50-mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location and be expected to work from the office at least four days per week.

Nice to have

• Master’s Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python.
• Experience with Ads platforms, real-time bidding systems, or large-scale monetization systems.
• Familiarity with GPU performance optimization concepts such as batching strategies, memory movement, model quantization, and efficient resource scheduling.

Culture & Benefits

• Employees come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals.
• Build on values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.