Senior Software Engineer, AI Gateway

Are you ready to unlock intelligence?

The AI Gateway team is on a mission to build the central nervous system for the agentic era, enabling developers to securely and reliably connect, observe, and manage their AI and ML services at scale. We are architecting the foundational layer that will power the next generation of intelligent applications. Your work will directly impact developer delight and ensure our infrastructure is the most trusted path for AI traffic in the world.

• Design, own, and lead the development of critical, high-performance components for Kong’s AI Gateway using Golang.
• Influence the technical roadmap and architecture, ensuring our systems are scalable, resilient, and prepared for future challenges.
• Architect solutions that prevent technical debt and maintain our commitment to 99.99% uptime and reliability.
• Mentor and guide other engineers on the team, fostering a culture of technical excellence and collaborative problem-solving.
• Drive best practices in testing, observability, and continuous integration/delivery within a complex, distributed environment.
• Collaborate cross-functionally with product management, SRE, and other engineering teams to deliver a world-class developer experience.
• Resolve complex technical issues and conduct deep-dives into system performance, identifying and addressing bottlenecks.
• Extensive professional experience building software in a systems language like Golang or Python.
• Deep understanding of distributed systems, microservice architectures, and API design principles.
• Proven experience with cloud-native technologies, including Kubernetes and Docker.
• Experience with or a strong interest in AI/ML infrastructure, such as LLM orchestration, vector databases, or model serving.
• Solid knowledge of networking fundamentals (TCP/IP, HTTP/2, gRPC).
• Ownership: You are a proactive problem-solver with a bias for action, taking full ownership of your work from concept to production.
• Urgency: You thrive in a fast-paced, high-growth environment, and you are driven to deliver results quickly and efficiently.
• Collaboration: You are an excellent communicator who works effectively with a globally distributed team to achieve shared goals.
• Contributions to open-source software projects.
• Experience with Nginx, Lua, or service mesh technologies.
• Familiarity with AI frameworks like LangChain, PyTorch, or TensorFlow.
• Prior experience building API gateways, developer platforms, or large-scale infrastructure-as-a-service products.