Software Engineer, Agentic Runtime (AI)

Location: Hybrid, with 4 days per week in the Mountain View, California office

Salary: $180,000–$210,000 annual base salary

Company

Glean provides an enterprise Work AI platform with search, AI assistants, scalable AI agents, SaaS connectors, LLM integrations, and APIs.

What you will do

• Own agentic runtime problems from architecture and design through production launch and ongoing reliability.
• Build core services for session lifecycle, streaming responses, structured tool execution, memory and state, policies, and guardrails.
• Improve performance, correctness, and cost by reducing p50/p95 latency, optimizing tail behavior, and managing token and tool budgets.
• Integrate OpenAI, Anthropic, Google Gemini, and internal evaluation frameworks to improve agent quality and predictability.
• Implement fault isolation, retries, timeouts, circuit breaking, backpressure, and graceful degradation.
• Develop observability, tracing, metrics, dashboards, playbooks, SLOs, and on-call practices while collaborating with product, quality, and application teams.

Requirements

• 3+ years of software engineering experience building production distributed systems or cloud-native applications.
• BS/BA in Computer Science or a related field, or equivalent practical experience.
• Strong coding skills in at least one of Python, Go, Java, JavaScript, TypeScript, or C++.
• Experience operating services on Kubernetes and at least one major cloud provider such as GCP, AWS, or Azure.
• Familiarity with event and streaming systems, caching, low-latency data stores, LLM tool calling, structured outputs, streaming, and model routing.
• Strong observability and production debugging skills, including tracing, metrics, dashboards, and production forensics.

Nice to have

• Experience with policy and guardrails, multi-tenant isolation, rate limiting, concurrency control, or cost optimization.
• Experience leading projects or working on agentic systems and ML infrastructure integrations.

Culture & Benefits

• Medical, vision, and dental coverage.
• Generous time-off policy and access to a 401(k) plan.
• Home office improvement, education, and wellness stipends.
• Regular company events and daily healthy lunches.
• Inclusive workplace with a focus on diversity and equal opportunity.

Hiring process

• Complete a brief AI-focused exercise or discussion during the interview process.