Model Behavior Architect (AI)

TL;DR

Model Behavior Architect (AI): Designing and refining context engineering strategies to guide model behavior across various use cases within an answer engine with an accent on identifying inconsistencies in model outputs through well-designed research and evaluation projects. Focus on developing automated pipelines for evaluating agent effectiveness at scale and staying updated with the latest alignment and evaluation techniques.

Location: San Francisco

Salary: $180K – $240K

Company

Perplexity is looking for a Model Behavior Architect to help shape our answer engine.

What you will do

• Design, refine, and implement context engineering strategies to guide model behavior across use cases.
• Identify inconsistencies in model outputs through well-designed research and evaluation projects.
• Develop automated and semi-automated pipelines for evaluating agent effectiveness at scale.
• Stay current with the latest alignment and evaluation techniques from both industry and academia.

Requirements

• Demonstrated passion for AI and can share specific, related projects you're proud of.
• Familiar with Python and able to prototype and debug systems at scale.
• High-level understanding of LLMs, training, and RL.
• Excellent communication skills, particularly in teaching complex concepts.
• Creative problem-solving abilities with a "hacker spirit" for solving puzzles.

Culture & Benefits

• Full-time U.S. employees enjoy a comprehensive benefits program including equity, health, dental, vision, retirement, fitness, commuter and dependent care accounts, and more.