Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)

Location: Onsite in New York, NY, United States

Annual base salary: $180,000–$240,000

Company

LangChain builds open-source frameworks and the LangSmith platform for building, evaluating, deploying, and operating AI agents at scale.

What you will do

• Design, develop, and maintain backend services and APIs for LangSmith tracing, monitoring, and evaluation workflows.
• Collaborate on architecture to build performant and maintainable systems.
• Optimize storage and query performance for high-volume observability and evaluation data.
• Improve reliability through testing, monitoring, and alerting.
• Troubleshoot production issues, perform root-cause analysis, and implement long-term fixes.
• Create technical documentation and collaborate with full-stack engineers, product managers, and product designers on new features.

Requirements

• 5+ years of professional backend engineering experience working on highly complex products.
• Proficiency in one or more backend languages or frameworks, ideally Python or Go.
• Strong understanding of API design and reliable data services.
• Experience with high-throughput or mission-critical systems.
• Demonstrated ability to optimize backend services for performance and reliability.
• Experience with Postgres, Redis, ClickHouse, and cloud platforms including AWS, GCP, or Azure.
• Strong communication skills and ability to collaborate cross-functionally.
• Customer centricity and an ownership mentality.

Culture & Benefits

• Full-time engineering role with meaningful impact on AI observability and evaluation products.
• Medical, dental, and vision coverage.
• Flexible vacation and a 401(k) plan.
• Meals on in-office days in the United States.
• Compensation may include variable compensation for relevant roles, equity, benefits, and perks.