Career EngineCareer Engine
Your matchExample
87%match
Why you fitThis role calls for Kubernetes and Distributed Systems — tell us what you know and we'll check the rest.
Gap to noteAlso lists ML Infrastructure — worth confirming before you apply.

Get roles like this, scored and matched, in your inbox.

Sign up free →

Job Opening

Cohere logo

Staff/Senior Staff Software Engineer, Agent Infrastructure

Cohere · Toronto, Ontario · Posted 15 days ago

ic
KubernetesDistributed SystemsML InfrastructureLLM AgentsModel RoutingSecure Code ExecutiongVisorFirecracker

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re building the next generation of agentic AI infrastructure at Cohere. This team sits at the intersection of ML systems, distributed infrastructure, and developer experience, creating the platform that powers autonomous AI agents at scale.

You’ll work on hard, forward-looking problems with few established patterns, including secure code execution, agent state management, model routing, identity and authentication, and resource management for long-running agent workflows.

This role is a strong fit for someone who combines systems depth with ML intuition. You should be comfortable building reliable infrastructure, thinking through distributed systems tradeoffs, and understanding how emerging agentic capabilities shape platform design.

WHAT YOU’LL WORK ON.

  • Secure execution environments for agent-generated code
  • Identity, authentication, and trust boundaries for agents
  • Model routing and orchestration across different model types and environments
  • Rate limiting, quotas, and resource management for agent workflows
  • State management, memory, and filesystem abstractions for agents.

IN THIS ROLE YOU WILL:

  • Turn emerging ML research ideas into production-ready infrastructure
  • Build core platform capabilities for execution, storage, and state management
  • Prototype and evaluate new technologies, then help decide what should move into production
  • Partner with research teams to shape infrastructure based on what future agent systems will need

YOU MAY BE A GOOD FIT IF YOU HAVE:

…

Apply on Cohere's site →

This posting is sourced from Cohere's own career site — applying takes you there directly.

Get roles like this, scored and matched, in your inbox.

Sign up free →

Related roles

This role is one of 9,091 Software Engineer openings and centers on Kubernetes, Distributed Systems, ML Infrastructure, and Llm Agents. There are 124 open roles at Cohere right now.

Want roles like this found for you?

Set your Focus once. Career Engine screens every new opening every week.

A scored, explained shortlist — not a keyword match — delivered weekly. Free for one profile.