Software Engineer, Agent Optimization & Evaluation (AI)

Location: Remote - United States

Base salary: $109,800–$325,000 USD per year, plus potential equity and commission depending on the position offered.

Company

Reddit operates a large-scale community platform and is building a next-generation AI developer platform for software development agents.

What you will do

• Design and build an optimization harness for evaluating, benchmarking, and improving AI agents across real software engineering workflows.
• Develop Reddit-specific evaluation environments and systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.
• Design model routing and orchestration strategies that optimize quality, latency, reliability, and cost.
• Define metrics and experimentation frameworks for measuring developer productivity and engineering velocity.
• Build tooling to analyze agent behavior, investigate failures, and accelerate iteration.
• Partner with Platform Engineering, Infrastructure, and Developer Productivity to integrate agent capabilities and shape a model-agnostic agent platform.

Requirements

• 5–12+ years of engineering experience.
• Extensive experience building and shipping large-scale production software systems.
• Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI, search, developer platforms, or other complex distributed systems.
• Strong understanding of modern LLMs, AI agents, and the engineering systems required to deploy them effectively.
• Experience optimizing across quality, latency, reliability, and cost.
• Excellent software engineering fundamentals and a focus on production-quality systems.
• Ability to work independently in ambiguous environments and drive technical direction for strategic initiatives.
• Strong cross-functional collaboration skills across engineering, infrastructure, and platform organizations.

Culture & Benefits

• Remote work for U.S.-based employees.
• Comprehensive healthcare benefits and income replacement programs.
• 401(k) with employer match.
• Flexible vacation, paid volunteer time off, and generous paid parental leave.
• Family planning support, gender-affirming care, and mental health and coaching benefits.
• Global benefits supporting workspace, professional development, and caregiving.

Hiring process

• Some interviews may be recorded, transcribed, and summarized by AI; candidates can opt out before scheduled interviews.
• Interview recordings are deleted promptly after a hiring decision.