Senior Software Engineer (AI Platform)

TL;DR

Senior Software Engineer (AI Platform): Building and operating the LLM and agent infrastructure used by all teams at Coinbase with an accent on gateway systems, agent runtimes, and knowledge bases. Focus on leading multi-quarter technical initiatives, implementing AI FinOps, and developing evaluation tooling for production-grade AI agents.

Location: Remote (USA or Latin America). Quarterly in-person working sessions ("surges") are required.

Salary: $186,065 — $218,900 USD

Company

A remote-first company focused on increasing economic freedom by building the future of finance.

What you will do

• Own the architecture and delivery of core platform systems, including the LLM Gateway, AI Hub, and agent runtimes with microVM sandboxes.
• Drive the design and implementation of Knowledge Base infrastructure connecting data sources to vector and markdown stores.
• Lead AI FinOps capabilities, including spend attribution, governance, and cost optimization company-wide.
• Build evaluation and observability tooling, such as LLM-as-judge harnesses and full tracing feedback loops.
• Partner with engineering, security, legal, and frontier labs to ship high-impact platform capabilities.
• Collaborate with teams to build production agents using fine-tuning and traditional ML.

Requirements

• 5+ years of software engineering experience in ML/AI infrastructure or distributed platform services at scale.
• Deep expertise in LLM orchestration patterns, agent frameworks, and vector databases.
• Fluency in Python and at least one systems language (Go, Rust, or C++).
• Proven track record of leading multi-quarter technical initiatives from design to production.
• Experience shipping governed AI systems in partnership with security and legal teams.
• Must be based in the USA or Latin America.

Culture & Benefits

• Remote-first work environment with quarterly mandatory in-person "surges".
• High-intensity, high-bar professional environment focused on pushing limits.
• Comprehensive benefits package including medical, dental, vision, and 401(k).
• Opportunity to shape the AI strategy of a leading financial technology platform.