Concept
Concept
Section titled “Concept”External endpoint
Section titled “External endpoint”An external endpoint allows external API services (such as third-party inference services like OpenAI, or internal endpoints within Neutree) to be proxied through the AI gateway for unified management, enabling unified authentication, routing, and usage statistics. Unlike endpoints, external endpoints do not require cluster resource allocation. They serve as proxy entry points for external services, forwarding requests to upstream services.
Model Usage
Section titled “Model Usage”Model Usage collects statistics on token usage generated through the AI Gateway.
Access Log
Section titled “Access Log”Access Log records request information for calls to endpoints and external endpoints through the AI Gateway.