Senior Software Engineer
Company: Cohere
Location: Toronto, Ontario, Canada {{REMOTE}}
Type: Full-time
Posted: 2026-05-12
About this role
- We’re building the next generation of agentic AI infrastructure at Cohere
- This team sits at the intersection of ML systems, distributed infrastructure, and developer experience, creating the platform that powers autonomous AI agents at scale
- You’ll work on hard, forward-looking problems with few established patterns, including secure code execution, agent state management, model routing, identity and authentication, and resource management for long-running agent workflows
- This role is a strong fit for someone who combines systems depth with ML intuition
- You should be comfortable building reliable infrastructure, thinking through distributed systems tradeoffs, and understanding how emerging agentic capabilities shape platform design
- Secure execution environments for agent-generated code
- Identity, authentication, and trust boundaries for agents
- Model routing and orchestration across different model types and environments
- Rate limiting, quotas, and resource management for agent workflows
- State management, memory, and filesystem abstractions for agents
- Turn emerging ML research ideas into production-ready infrastructure
- Build core platform capabilities for execution, storage, and state management
- Prototype and evaluate new technologies, then help decide what should move into production
- Partner with research teams to shape infrastructure based on what future agent systems will need
### Benefits
- Six weeks’ paid vacation
- Equity / stock options
- RRSP, 401(k), and Pension Scheme contributions
- Coverage for 100% of your insurance premiums across health, dental, vision, and travel
- Additional coverage for accessing mental health providers/services
- Six months of fully paid parental leave, including adoption and surrogacy
- Financial support for egg freezing and IVF in Canada and the UK
- A monthly fitness and wellness allowance
- Globally dispersed company that supports a remote work culture
- A $2,000 annual education benefit for professi...