Get roles like this, scored and matched, in your inbox.
Sign up free →Job Opening
Staff/Senior Staff Software Engineer, Agent Infrastructure
Cohere · Toronto, Ontario · Posted 15 days ago
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re building the next generation of agentic AI infrastructure at Cohere. This team sits at the intersection of ML systems, distributed infrastructure, and developer experience, creating the platform that powers autonomous AI agents at scale.
You’ll work on hard, forward-looking problems with few established patterns, including secure code execution, agent state management, model routing, identity and authentication, and resource management for long-running agent workflows.
This role is a strong fit for someone who combines systems depth with ML intuition. You should be comfortable building reliable infrastructure, thinking through distributed systems tradeoffs, and understanding how emerging agentic capabilities shape platform design.
WHAT YOU’LL WORK ON.
- Secure execution environments for agent-generated code
- Identity, authentication, and trust boundaries for agents
- Model routing and orchestration across different model types and environments
- Rate limiting, quotas, and resource management for agent workflows
- State management, memory, and filesystem abstractions for agents.
IN THIS ROLE YOU WILL:
- Turn emerging ML research ideas into production-ready infrastructure
- Build core platform capabilities for execution, storage, and state management
- Prototype and evaluate new technologies, then help decide what should move into production
- Partner with research teams to shape infrastructure based on what future agent systems will need
YOU MAY BE A GOOD FIT IF YOU HAVE:
…
This posting is sourced from Cohere's own career site — applying takes you there directly.
Get roles like this, scored and matched, in your inbox.
Sign up free →Related roles
This role is one of 9,091 Software Engineer openings and centers on Kubernetes, Distributed Systems, ML Infrastructure, and Llm Agents. There are 124 open roles at Cohere right now.
Want roles like this found for you?
Set your Focus once. Career Engine screens every new opening every week.
A scored, explained shortlist — not a keyword match — delivered weekly. Free for one profile.