Member of Technical Staff – Full Stack Software Engineer (AI)

TL;DR

Member of Technical Staff – Full Stack Software Engineer (AI): Building evaluation platform for personalized AI assistant Copilot across data sampling, AI data collection and processing, analysis, and insight generation with an accent on full-stack development, prompt engineering, and automation tools. Focus on designing scalable pipeline architecture, conducting statistical analysis, creating dashboards, and collaborating to enhance product quality and performance.

Location: Required to be local to Redmond, WA or Mountain View, CA and in office 4 days a week.

Salary: USD $100,600 – $199,000 per year (IC3 across U.S.), USD $119,800 – $234,700 (IC4), higher ranges in San Francisco Bay area and New York City.

Company

hirify.global AI organization dedicated to advancing Copilot and other consumer AI products and research, collaborating with Bing, Edge, MSN, and Shopping teams.

What you will do

• Work across full stack of evaluation platform: backend databases, middle-tier services, browser/mobile automation, statistical analysis, and dashboards.
• Design pipeline architecture for rapid iteration and scalability.
• Conduct experimentation with A/B evaluation, data sampling, measurement, and post-analysis of labeled data.
• Develop insights from metrics to enhance Copilot’s relevance, performance, trustworthiness, and visual appeal.
• Collaborate with product teams to address quality gaps and translate metrics into actionable improvements.

Requirements

• Bachelor’s Degree in Computer Science or related AND 4+ years technical engineering experience with coding in C#, Java, Python or equivalent.
• Expertise in experimentation methodologies, A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis.
• Local to Redmond, WA or Mountain View, CA and available to work in office 4 days a week.

Nice to have

• 2+ years with SQL, PostgreSQL or MySQL.
• 2+ years building scalable services on Azure, AWS, or GCP with datastores.
• Experience with Visual Studio/VS Code, HTML/CSS/JavaScript/ASP.NET/REST/jQuery.
• Familiarity with browser automation (Selenium, Puppeteer, Playwright), mobile automation (Appium), LLMs, AI ChatBots, prompt engineering.
• Azure DevOps, GIT, Azure OpenAI, Azure Foundry; leading technical projects.

Culture & Benefits

• Growth mindset, innovation, collaboration aligned with hirify.global values of respect, integrity, and accountability.
• Culture of inclusion where everyone can thrive.
• Benefits and other compensation eligibility; details at careers.hirify.global.com.