Senior Software Engineer (AI)

TL;DR

Senior Software Engineer (AI Tools): Designing and scaling the AI platform layer and developer tools including LLM gateways and agentic workflows with an accent on platform engineering and developer experience. Focus on building AI-native agents, implementing technical guardrails for responsible AI, and optimizing LLM integration for enterprise-scale software.

Location: USA, Pleasanton, CA (Hybrid: must spend at least 50% of time each quarter in the office or in the field)

Salary: $148,200 – $264,000 USD

Company

A Fortune 500 company and leading AI platform for managing people, money, and agents.

What you will do

• Design and build the AI platform layer, including LLM gateways, MCP registries, and shared abstraction APIs.
• Architect and implement AI agents and automation to improve developer workflows, such as code review, testing, and documentation.
• Drive the evaluation and integration of AI model providers, optimizing for cost, safety, and performance.
• Lead technical design for complex, cross-cutting projects in partnership with Security, DevEx, and infrastructure teams.
• Build observability and governance tooling to provide visibility into AI tool usage across the organization.
• Operationalize AI policy and compliance requirements into the technical platform.

Requirements

• 5+ years of software engineering experience.
• 3+ years of experience building and operating backend services or platform infrastructure in production.
• Strong proficiency in Python and/or TypeScript.
• Hands-on experience with LLM APIs, prompt engineering, and evaluation pipelines.
• Robust understanding of AI security principles, including prompt injection and data leakage risks.
• Must be based in the USA to satisfy hybrid office requirements.

Nice to have

• Experience designing and shipping reliable AI agents using frameworks like ReAct.
• Experience building MCP servers or tool-use integrations (e.g., Claude skills).
• Proficiency with Kubernetes, Docker, and deploying services to cloud environments.
• Knowledge of enterprise security patterns like SSO, authentication, and secrets management.
• Experience with observability tooling for logging, metrics, and tracing.

Culture & Benefits

• Flex Work policy allowing for a flexible schedule provided 50% of time per quarter is spent in-office.
• Culture rooted in integrity, empathy, and shared enthusiasm.
• Comprehensive compensation package including bonus plans and annual refresh stock grants.
• Investment in professional growth and a supportive environment for taking technical risks.