Agentic AI Infrastructure Engineer

Location: Remote in Canada or the United States; offices are available in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.

Compensation: USA California, New York, and Washington: $180K–$260K plus equity; other US states: $160K–$235K plus equity; Canada: CA$230K–CA$330K plus equity.

Company

Cohere is a security-first enterprise AI company building foundation models and end-to-end products for business applications.

What you will do

• Build secure execution environments for agent-generated code, along with core platform capabilities for execution, storage, and state management.
• Design identity, authentication, trust boundaries, model routing, orchestration, rate limiting, quotas, and resource management for agent workflows.
• Develop state management, memory, and filesystem abstractions for autonomous AI agents.
• Turn emerging ML research ideas into production-ready infrastructure.
• Prototype and evaluate technologies, deciding which capabilities should move into production.
• Partner with research teams to shape infrastructure for future agent systems.

Requirements

• Experience building production ML infrastructure with strong systems fundamentals.
• Hands-on experience with agentic systems, multi-agent workflows, or agent development frameworks.
• Familiarity with model routing and LLM provider frameworks across different model types and environments.
• Experience with scalable, fault-tolerant distributed systems and Kubernetes.
• A track record of moving quickly on prototypes and making sound productionization decisions.

Nice to have

• Experience across on-premises, private cloud, and public cloud environments.
• Familiarity with storage systems, embedded databases, or filesystem abstractions.
• Experience with code execution sandboxes such as gVisor, Firecracker, Kata, or WASM runtimes.
• Interest in emerging ML infrastructure, edge inference, or browser-native models.
• Open-source contributions to LLM or agent infrastructure projects.
• Experience with identity, workload authentication, or capability-based security systems.

Culture & Benefits

• Remote-friendly work with coworking support for people away from an office, a $500 home office stipend, and travel budgets for other offices.
• Six weeks of paid vacation, parental leave top-up for up to six months, and health and dental benefits with a separate mental health budget.
• Lunch stipend of $75/£75 or local-currency equivalent, plus annual enrichment benefits for arts and culture, fitness and wellness, quality time, and workspace improvements.
• Education and learning stipend for conferences, courses, and coaching.
• RRSP matching, 401(k), and pension scheme benefits where applicable.
• Annual company offsite and regular community and social events for office-based employees.