> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.fabricgateway.ai/configure/connections/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.fabricgateway.ai/_mcp/server. # Manage connections and routes > Connect and manage LLM providers, MCP servers, and REST APIs, and review the routes that expose them. Fabric AI Gateway can manage your **LLM providers**, **MCP servers**, and plain **REST APIs**. They share the same underlying connection model: a connection, one or more routes, and an upstream target. Each type also has settings specific to its protocol. This topic shows you how to choose what to connect and how to review your connections, routes, and providers. If you haven't connected anything yet, start with [Quickstart: Send your first request on the hosted gateway](/get-started/quickstart). ## Choose what to connect | What you connect | Use it to | Guide | | ---------------- | ---------------------------------------------------------------- | --------------------------------------------------------------- | | **LLM provider** | Proxy requests to a model provider, such as Anthropic or OpenAI. | [Connect an LLM provider](/configure/connections/llm-providers) | | **MCP server** | Expose tools and resources to agents over MCP. | [Connect an MCP server](/configure/connections/mcp-servers) | | **REST API** | Connect a plain HTTP API by importing an OpenAPI spec. | [Connect a REST API](/configure/connections/rest-apis) | ## Understand the LLMs page **LLMs** has the following components: | Component | What it's for | | --------------- | ---------------------------------------------------------------------------------------------------------------- | | **Connections** | Every LLM provider you've connected, such as `anthropic`, `bedrock`, or `openai`. | | **Routes** | The route generated for each connection, including every path it exposes and the plugin instance attached to it. | | **Providers** | The full catalog of LLM providers available to connect in your organization. | Each tab shows a count, for example the number of connections. ### View your connections To view your LLM connections, do the following: 1. In the sidebar, select **LLMs**. 2. Click the **Connections** tab. Each connection card shows the connection name, an **Open** or **Gated** badge, the provider icon, and the target URL. Use **Search connections** to find a connection. In organizations with many connections, the list spans several pages, and the footer shows the range you're viewing, for example **1–24 of 165 connections**. To add another provider, click **Create connection**. You can also specify your own target URL, which lets you connect a model that you host yourself. ### Open a connection To open a connection, select it in the **Connections** tab. The page shows the connection's name and type, for example **LLM · Amazon Bedrock Mantle**, and a ⋯ menu. It has the following tabs: | Tab | What it shows | | ------------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | **Overview** | **Description**, **Access**, and **Models**, each with **Edit**. **Network** shows **Public** or **Private** and can't be edited. **Upstreams** shows how many upstreams the connection has and how it balances them, for example **1 · Round robin**. | | **Upstream** | The upstream URLs and the balancing method, with **Edit**. **Auth requirement** shows what Fabric sends to the upstream and in which header: **Auth type** (for example **Bearer token**), **Applies to** (for example **Shared**), **Header** (for example `Authorization`), and **Credential**. If no credential exists, select **Add credential**. | | **Routes** | The routes for this connection, with an **Edit** link on each. Select **Add route** to add one. | | **Plugins** | The plugin instances that apply to the connection. | | **Access** | Grants for a gated connection. The tab is unavailable while **Access** is **Open**. | ### View your routes To view the routes generated for your connections, do the following: 1. In the sidebar, select **LLMs**. 2. Select the **Routes** tab. Each row shows a route's paths and methods, along with the plugin instance attached to it. For example: | Route | Paths | Plugin instance | | ----------------- | ------------------------------------------------------------------------------------------------------------------ | ----------------------------- | | `anthropic-route` | `/anthropic/v1/messages` (POST), `/anthropic/v1/messages/count_tokens` (ANY), `/anthropic/v1/models` (GET) | `route-auth--anthropic-route` | | `openai-route` | Chat completions, responses, embeddings, models, audio transcription and speech, image generation, and moderations | `route-auth--openai-route` | Use **Search routes** to find a route, the **All connections** filter to show the routes for one connection, and the sort menu to order the list by name. Each row has a copy icon that copies the route's base URL, and a ⋯ menu with the endpoint actions, such as **Copy chat URL (POST)** and **Copy chat cURL (POST)**. The menu offers only the endpoints that the route exposes. Fabric names a new route after its connection, `-route`, and names the route's Key Auth instance `route-auth--`. ### Add a route A connection gets its first route when you create it. To add another route, for example with different authentication, or one route that serves several connections, do the following: 1. In the sidebar, select **LLMs**, **MCP servers**, or **Services**, and then select the **Routes** tab. Select **Create route**. You can also open a connection, select its **Routes** tab, and select **Add route**. 2. In **Route**, enter a **Name**, choose the **Protocol**, and select one or more **Connections**. 3. In **Request matching**, optionally enter a **Base path**, for example `/provider`. To add more conditions, expand **Advanced matching**. 4. Keep **Require gateway auth** selected unless the route serves public endpoints. Fabric sets **Auth type** to **Gateway key** and shows the **Request header**, `fg-api-key`, which you can't change. Select **Create key** if you need a key. 5. Select **Create route**. ### Browse available providers To browse the LLM provider catalog, do the following: 1. In the sidebar, select **LLMs**. 2. Select the **Providers** tab. This tab lists every LLM provider that you can connect in your organization. Click **Connect** next to a provider to open the **Create LLM connection** page. ## Set the access mode Access is a setting on the connection, and it applies to the connection on every route: | Access mode | Behavior | | ----------- | ------------------------------------------------------------------------------------- | | **Open** | Anyone who passes gateway auth can call the connection. | | **Gated** | Only callers with a grant can call the connection. The gateway refuses other callers. | You set **Access** in the **Connection** section when you create a connection. To change it later, open the connection, and then on the **Overview** tab, select **Edit** next to **Access**. To give callers access to a gated connection, open the connection, select the **Access** tab, and then select **Add grant**. In **Grant access to**, choose who the grant covers: | Option | Who gets access | | ------------ | ------------------------------------------------------------- | | **User** | One user. | | **Route** | Every authenticated caller on one route to the connection. | | **Everyone** | Every authenticated caller, on every route to the connection. | ## Next steps * To add authentication, rate limiting, routing, or transforms to any of these routes, see [Control traffic with plugins](/configure/plugins). * To monitor traffic on these routes, see [Monitor gateway traffic](/use/monitor). * To add an upstream credential for a connection, see [Manage credentials and vaults](/configure/credentials). ## Docs - [Connect an LLM provider](https://docs.fabricgateway.ai/configure/connections/llm-providers.md): Connect an LLM provider, create a route for it, and create a gateway key for callers. - [Connect to a provider over a private network](https://docs.fabricgateway.ai/configure/connections/private-connections.md): Send LLM traffic to a provider through Fabric's private endpoint instead of the public internet, and set up the AWS role that Fabric assumes. - [Connect an MCP server](https://docs.fabricgateway.ai/configure/connections/mcp-servers.md): Create an MCP server connection, add upstreams, and set the access mode. - [Connect a REST API](https://docs.fabricgateway.ai/configure/connections/rest-apis.md): Connect a REST API as a connection, either manually or by importing an OpenAPI spec that generates its routes.