Staff Software Engineer (AI Agent Quality)

Location: New York City, New York, United States

Salary: $200,000–$265,000 USD annually

Company

Databricks is a data and AI company providing a unified platform for building and scaling data and AI applications, analytics, and agents.

What you will do

• Build foundational evaluation infrastructure for Genie Agents, including benchmarking, regression detection, and quality measurement.
• Develop tooling and workflows that enable researchers and engineers to evaluate AI agents rigorously.
• Connect production signals, training, and iterative development into a continuous agent-improvement flywheel.
• Shape the technical direction of agent quality infrastructure and the agent development platform.
• Partner with researchers and engineers across teams to turn ideas into reliable internal platforms.

Requirements

• 6+ years of industry experience building software systems.
• Strong Python programming skills and experience building production or research infrastructure.
• Experience with distributed systems, data pipelines, or large-scale infrastructure.
• Focus on reliability, correctness, operational maturity, and reproducible system signals.
• Ability to work across ambiguous research and product boundaries, influence roadmaps, and take strong ownership.

Nice to have

• Experience with developer tools, CI/CD platforms, testing frameworks, observability tooling, or benchmarking infrastructure.
• Familiarity with measuring LLM or AI agent quality through evaluations, experimentation platforms, or production monitoring.

Culture & Benefits

• Comprehensive employee benefits and perks, varying by region.
• Inclusive culture and equal employment opportunity practices.
• Potential eligibility for an annual performance bonus and equity.
• Databricks operates a global network of offices and serves organizations worldwide.