Concept

External endpoint

An external endpoint allows external API services (such as third-party inference services like OpenAI, or internal endpoints within Neutree) to be proxied through the AI gateway for unified management, enabling unified authentication, routing, and usage statistics. Unlike endpoints, external endpoints do not require cluster resource allocation. They serve as proxy entry points for external services, forwarding requests to upstream services.