MTS – Data Engineering (AI)

TL;DR

MTS – Data Engineering (AI): Architecting and implementing the data backbone that powers Copilot for millions of users, from building high-scale ETL pipelines to crafting experimentation frameworks. Focus on solving complex data challenges, optimizing pipeline performance for ML model evaluation, and ensuring rock-solid data quality across systems.

Location: Hybrid in Redmond or San Francisco, United States (3 days a week in office required)

Salary: $139,900 – $331,200 per year

Company

hirify.global is committed to empowering every person and organization on the planet to achieve more through innovation and collaboration.

What you will do

• Build, maintain, and enhance data ETL pipelines for processing large-scale data with low latency and high throughput to support Copilot operations.
• Design and maintain high throughput, low latency experimentation reporting pipelines to measure model performance and user engagement.
• Own data quality initiatives including monitoring, alerting, validation, and remediation processes.
• Implement robust schema management solutions for quick and seamless schema evolution.
• Develop and maintain data infrastructure supporting real-time and batch processing for machine learning model training and inference.
• Collaborate with ML engineers and data scientists to optimize data access patterns and pipeline performance.

Requirements

• Master’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering; OR Bachelor’s Degree in a related field AND 6+ years experience.
• Must be local to the San Francisco or Redmond area and in office 3 days a week.

Nice to have

• Experience building and maintaining production data pipelines at scale using technologies such as Apache Spark, Kafka, or similar distributed processing frameworks.
• Experience writing production-quality Python, Scala, or Java code for data processing applications.
• Experience building and scaling experimentation frameworks.
• Experience with cloud data platforms (Azure, AWS, or GCP) and their data services.
• Experience with data orchestration frameworks such as Airflow, Prefect, or Dagster.

Culture & Benefits

• Join a team that fosters a growth mindset, innovation, and collaboration to realize shared goals.
• Work within a culture of inclusion built on values of respect, integrity, and accountability.
• Opportunities to architect and implement the data backbone for a widely used product (Copilot).
• Freedom to innovate and support to build world-class data products.
• Certain roles may be eligible for benefits and other compensation; details provided via Microsoft Careers.