Applied Science Manager (AI)

TL;DR

Applied Science Manager (AI): Leading the continuous model evaluation and learning for agentic brand-intelligence systems in hirify.global Ads with an accent on defining quality metrics, evaluation frameworks, and autonomous detect-diagnose-remediate loops. Focus on designing LLM-as-Judge rubrics, optimization engines for prompts and agents, and ensuring offline-to-online consistency for production-scale quality.

Location: USA, NY, New York or USA, WA, Seattle

Salary: USA, NY, New York - $202,200 - $273,600 USD annually; USA, WA, Seattle - $183,800 - $248,700 USD annually

Company

hirify.global Ads team pioneering generative AI technologies to revolutionize advertising experiences across hirify.global.com.

What you will do

• Lead, mentor, and grow a team of applied scientists and ML engineers focused on scientific excellence and ownership.
• Own the scientific vision and roadmap for continuous model evaluation and learning in brand-intelligence systems.
• Design evaluation frameworks including LLM-as-Judge, multi-model ensembles, gold-set construction, and human calibration.
• Develop optimization engines for prompt refinement, synthetic data generation, and agent decomposition strategies.
• Establish offline-to-online consistency, A/B testing, and drift monitoring for production quality improvements.
• Communicate vision, breakthroughs, and outcomes to senior leadership and align with hirify.global Advertising goals.

Requirements

• 4+ years applied research experience
• 3+ years managing scientists or ML engineers
• 3+ years building ML models for business applications
• PhD or Master's + 6+ years applied research
• Knowledge of ML, NLP, Information Retrieval, and Analytics
• Experience programming in Java, C++, Python or similar

Nice to have

• Experience in recommender systems or personalization in search, e-commerce, or advertising
• PhD in CS, ML, engineering or related, or Master's + 4+ years quantitative experience
• Publications at top-tier conferences/journals
• 5+ years managing scientists/ML engineers
• Hands-on with LLM-based agentic systems (tool use, planning, RAG, multi-agent)
• Experience with LLM fine-tuning (SFT, RLHF, DPO), prompt engineering, optimization

Culture & Benefits

• Inclusive culture empowering high performance and customer obsession.
• Comprehensive benefits: medical/dental/vision insurance, 401(k) matching, paid time off, parental leave.
• Sign-on payments and RSUs; flexible spending accounts, adoption reimbursement.
• EAP, mental health support, medical advice line, supplemental life plans.