Skip to main content

AI Gateway

AI Gateway is the unified AI interface management module in the CSGHub Admin Panel. It consolidates management of the platform's self-hosted Serverless inference services, third-party commercial API integrations, and centralized MCP Server registration. The AI Gateway menu group is located in the left navigation bar, below the Computing Power Management group, and contains the following three sub-modules:

  • Public Inference: Manage the platform's self-hosted Serverless inference services.
  • Commercial API: Configure and manage proxied third-party commercial model services.
  • MCP Gateway: Centrally register and manage remote MCP Servers.

1. Public Inference ​

Manage the platform's externally available Serverless inference services. Supports filtering by status (Active / Stopped) and configuring billing policies for each service. The list displays the service name, status, whether billing is enabled (Yes/No), and the price (In/Out).

Click Edit to configure:

  • Billing Switch: Toggle on/off. When enabled, all API calls to this model will be billed per token.
  • Input Token Price: Unit price for the Prompt phase, in CNY per million tokens.
  • Output Token Price: Unit price for the Completion phase, in CNY per million tokens.

alt text

2. Commercial API ​

Configure and manage third-party AI services proxied through the platform. The list includes model name, provider, status, and a Price (Input/Output) column populated from the SKU configuration in the detail page.

Click Edit to configure:

  • Endpoint URL and API Key: The third-party service's access URL and authorization credentials.
  • Price (SKU): Set the published input/output token prices (CNY per million tokens). Prices can be entered manually or selected from a preset SKU.
  • Summary: A short description of the model, displayed on the user-facing service list.
  • README: A Markdown document with detailed usage instructions. Once published, it syncs to the model detail page visible to developers.

3. MCP Gateway ​

MCP Gateway supports centralized registration and management of remote MCP Servers. By configuring the Endpoint URL, connection type, and request headers, remote MCP Servers can be connected to the platform, which then provides a unified MCP service access point for applications.

alt text

Supports editing registered MCP Servers, including name, description, Endpoint URL, connection type, and request headers.

alt text