Researcher, Education Labs (AI)

TL;DR

Researcher, Education Labs (AI): Designing and running mixed-methods studies to measure how people learn and build capability with AI systems with an accent on psychometrics, experimental design, and translating research into product improvements. Focus on building validated instruments and tools to evaluate AI fluency and human-AI interaction in real-world learning settings.

Location: Must be based in or able to commute to San Francisco, CA or New York City, NY (Hybrid: 25%+ in-office)

Salary: $300,000 - $405,000 USD

Company

Anthropic is an AI safety and research company dedicated to building reliable, interpretable, and steerable AI systems.

What you will do

• Design and execute mixed-methods studies to measure capability growth in AI-assisted learning.
• Build and validate psychometric instruments and evaluation methods for research and product teams.
• Collaborate with engineers and designers to translate research insights into product features and curriculum.
• Develop software tools to collect and analyze validated metrics at scale.
• Communicate research findings through clear writing and presentations to influence organizational strategy.
• Determine the viability of research experiments for scaling or iteration.

Requirements

• Research background in learning sciences, education, cognitive science, HCI, or educational psychology.
• Strong mixed-methods skills including experimental design, measurement, and qualitative analysis.
• Technical proficiency in Python and data analysis, with experience working with LLMs.
• Ability to work in hybrid settings in San Francisco or New York City.
• Comfort with ambiguity and rapid, iterative inquiry in a fast-paced environment.
• Strong communication skills for cross-functional collaboration with product and engineering teams.

Nice to have

• Experience with experimentation frameworks and A/B testing in production.
• Background in building tools for non-technical collaborators to evaluate AI systems.
• Published work or open-source contributions related to skill development or human-AI interaction.
• Experience in learning platforms, developer tools, or creative tools.

Culture & Benefits

• Competitive compensation and benefits package.
• Generous vacation and parental leave policies.
• Flexible working hours and collaborative office environments.
• Optional equity donation matching.
• Focus on high-impact, collaborative research in a cohesive team environment.