Software Engineer AI Gateway

Overview

In this role you join the AI Gateway Engineering Team to build and evolve the Kong AI gateway. You will tackle multi-LLM routing, semantic routing, and performance-focused features that power AI-enabled workflows. You will contribute to a scalable API management stack, bridging Kong with third-party deployment platforms, and drive reliability at scale. This role offers hands-on development, optimization, and cross-functional collaboration in a mission-driven, innovative environment. You will help shape how organizations govern AI and LLM-based innovation.

Responsabilità

• Build and maintain API management software for AI/LLMs and its underlying stack
• Implement features like proxying, load balancing, and databases support for Kong AI Gateway
• Troubleshoot bugs, tune performance, and perform low-level optimizations
• Bridge Kong with third-party deployment platforms and tooling
• Handle additional tasks as directed by management

Requisiti fondamentali

• 3+ years of server-side application and component development
• Hands-on experience with Golang or Rust
• Experience building and debugging highly scalable, distributed, reliable systems
• Strong Linux systems troubleshooting and profiling skills
• Knowledge of distributed systems and Linux networking; API exposure on L7/L4
• Comfortable working with a remotely distributed team
• Strong ownership and communication skills; experience documenting products
• Familiarity with AI/LLM concepts and applications development
• strong communication
• ownership
• collaboration
• Golang or Rust
• Linux troubleshooting and profiling
• distributed systems