Member of Technical Staff – Data Engineering Manager – Microsoft AI – Copilot

TL;DR

Member Of Technical Staff – Data Engineering Manager (AI): Building mission-critical data pipelines that ingest, process, and publish data streams from Copilot systems with an accent on big data processing technologies. Focus on architecting solutions that stand the test of time and managing a small team of senior data engineers.

Location: Expected to work from a designated Microsoft office at least four days a week if living within 50 miles (U.S.) of that location

Salary: USD $139,900 – $274,800 per year (The typical base pay range for this role across the U.S.) or USD $188,000 – $304,200 per year (within the San Francisco Bay area and New York City metropolitan area)

Company

Microsoft’s mission is to empower every person and every organization on the planet to achieve more.

What you will do

• Build scalable data pipelines for sourcing, transforming, and publishing data assets for AI use cases.
• Collaborate with other Platform, infrastructure, application engineers, as well as AI Researchers to build next generation data platform products and services.
• Ship high-quality, well-tested, secure, and maintainable code.
• Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
• Manage a small team of 4 or 5 senior data engineers, talent management experiences and operational excellence for data platform.

Requirements

• Bachelor’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work or Master’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, or data engineering work or equivalent experience.
• 4+ years technical engineering experience building data processing applications (batch and streaming) with coding in languages including, but not limited to, Python, Java, Spark, SQL.
• Experience working with Apache Hadoop eco system, Kafka, NoSQL, etc.
• 3+ years experience with data governance, data compliance and/or data security.
• 2+ years’ experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP. Extensive use datastores like RDBMS, key-value stores, etc.
• 2+ years’ experience building distributed systems at scale and extensive systems knowledge that spans bare-metal hosts to containers to networking.

Culture & Benefits

• Embody our Culture and Values.
• Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience.
• Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security.
• Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, designers, and other engineers.
• Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.