Applied AI Engineer (LLM)

TL;DR

Applied AI Engineer (LLM): Building next-generation AI assistants and productivity capabilities with an accent on LLM product engineering, evaluation science, and prompt architectures. Focus on designing agentic behaviors, building robust evaluation frameworks for hillclimbing, and integrating LLMs into production-grade systems.

Location: Must be based in Mountain View, California, USA

Salary: $100,600 - $258,000 per year

Company

hirify.global is a high-ownership team building cutting-edge AI capabilities as part of Microsoft.

What you will do

• Design and ship LLM-powered assistant features, including conversational flows, agentic behaviors, and retrieval pipelines.
• Build prompt architectures and orchestration logic to ensure reliability, grounding, and personality consistency.
• Develop evaluation frameworks and run hillclimbing loops to continuously improve assistant performance.
• Create internal tools for prompt experimentation, model comparison telemetry, and automated eval pipelines.
• Integrate LLMs with product surfaces, APIs, and backend systems, building lightweight ML components.
• Collaborate with PMs, designers, and researchers in a high-velocity environment to turn ideas into polished UX.

Requirements

• Location: Must be based in Mountain View, California, USA.
• PhD in CS/Math/Stats, OR Master's with 1+ year of data science experience, OR Bachelor's with 2+ years of data science experience.
• Proven experience shipping production-level code, models, or data analysis.
• Experience managing structured and unstructured data and applying statistical techniques.

Nice to have

• 5+ years of experience for Bachelor's degree holders.
• Deep experience building zero-to-one products and working in mid-stage startup environments.
• Hands-on experience with hillclimbing AI evaluations and AI-assisted coding techniques.

Culture & Benefits

• High-ownership environment with startup-founder energy and a bias for action.
• Culture of experimentation, rapid iteration, and immediate impact.
• Competitive compensation and benefits provided by Microsoft.