Get roles like this, scored and matched, in your inbox.
Sign up free →Job Opening
Software Engineer 2, AI Gateway
kong · Milan, Lombardy · Posted 13 days ago
Build core multi-LLM routing, semantic caching, and MCP features for Kong's AI Gateway, which governs AI and LLM traffic for companies and developers worldwide.
Are you ready to unlock intelligence?
You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation.
As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.
- Responsible for building and maintaining API management software for AI and LLMs and its underlying stack.
- Implement new innovative features including proxying capabilities, load balancing, databases support that extend Kong AI Gateway’s offering.
- Bugs troubleshooting, performance tuning and low-level optimizations.
- Any additional tasks required by manager.
- 3+ years of programming in server-side applications and components.
- Hands on experience with either Golang or Rust
- Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
This posting is sourced from kong's own career site — applying takes you there directly.
Get roles like this, scored and matched, in your inbox.
Sign up free →Related roles
This role is one of 9,090 Software Engineer openings and centers on Go, Rust, Server-side Programming, and Distributed Systems. There are 112 open roles at kong right now.
Want roles like this found for you?
Set your Focus once. Career Engine screens every new opening every week.
A scored, explained shortlist — not a keyword match — delivered weekly. Free for one profile.