Senior Applied Scientist (Agentic AI)

TL;DR

Senior Applied Scientist (Agentic AI): Designing and developing agentic evaluation frameworks and training critic models to assess AI agent performance at scale with an accent on generative AI and foundational models. Focus on building automated evaluation systems, conducting original research, and delivering end-to-end solutions as managed AWS services.

Location: Must be based in Santa Clara, CA, USA

Salary: $192,200 – $260,000 USD annually

Company

hirify.global Web Services (AWS) is a comprehensive cloud platform providing a robust suite of products and services to power businesses ranging from startups to Global 500 companies.

What you will do

• Lead the design and development of agentic evaluation frameworks and evaluation/critic model training.
• Define evaluation methodologies and create benchmarks to measure agent performance.
• Own the end-to-end lifecycle from research and data curation to production deployment.
• Collaborate with cross-functional stakeholders to translate science insights into actionable improvements.
• Mentor junior scientists and contribute to the broader research community.
• Deliver evaluation capabilities as managed AWS services.

Requirements

• 3+ years of experience building machine learning models for business applications.
• PhD or Master's degree with 6+ years of applied research experience.
• Proficiency in programming with Java, C++, or Python.
• Experience with neural deep learning methods and machine learning.
• Must be authorized to work in the USA.

Nice to have

• Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, or scipy.
• Experience with large-scale distributed systems like Hadoop or Spark.

Culture & Benefits

• Comprehensive health insurance including medical, dental, vision, and mental health support.
• 401(k) matching and competitive compensation packages including RSUs.
• Paid time off and parental leave.
• Inclusive team culture with employee-led affinity groups.
• Focus on work-life harmony and professional mentorship.