Manage connections and routes
Fabric AI Gateway can manage your LLM providers, MCP servers, and plain REST APIs. They share the same underlying connection model: a connection, one or more routes, and an upstream target. Each type also has settings specific to its protocol.
This topic shows you how to choose what to connect and how to review your connections, routes, and providers. If you haven’t connected anything yet, start with Quickstart: Send your first request on the hosted gateway.
Choose what to connect
Understand the LLMs page
LLMs has the following components:
Each tab shows a count, for example the number of connections.
View your connections
To view your LLM connections, do the following:
- In the sidebar, select LLMs.
- Click the Connections tab.
Each connection card shows the connection name, an Open or Gated badge, the provider icon, and the target URL. Use Search connections to find a connection. In organizations with many connections, the list spans several pages, and the footer shows the range you’re viewing, for example 1–24 of 165 connections. To add another provider, click Create connection. You can also specify your own target URL, which lets you connect a model that you host yourself.
Open a connection
To open a connection, select it in the Connections tab. The page shows the connection’s name and type, for example LLM · Amazon Bedrock Mantle, and a ⋯ menu. It has the following tabs:
View your routes
To view the routes generated for your connections, do the following:
- In the sidebar, select LLMs.
- Select the Routes tab.
Each row shows a route’s paths and methods, along with the plugin instance attached to it. For example:
Use Search routes to find a route, the All connections filter to show the routes for one connection, and the sort menu to order the list by name. Each row has a copy icon that copies the route’s base URL, and a ⋯ menu with the endpoint actions, such as Copy chat URL (POST) and Copy chat cURL (POST). The menu offers only the endpoints that the route exposes.
Fabric names a new route after its connection, <connection>-route, and names the route’s Key Auth instance route-auth--<route>.
Add a route
A connection gets its first route when you create it. To add another route, for example with different authentication, or one route that serves several connections, do the following:
- In the sidebar, select LLMs, MCP servers, or Services, and then select the Routes tab. Select Create route. You can also open a connection, select its Routes tab, and select Add route.
- In Route, enter a Name, choose the Protocol, and select one or more Connections.
- In Request matching, optionally enter a Base path, for example
/provider. To add more conditions, expand Advanced matching. - Keep Require gateway auth selected unless the route serves public endpoints. Fabric sets Auth type to Gateway key and shows the Request header,
fg-api-key, which you can’t change. Select Create key if you need a key. - Select Create route.
Browse available providers
To browse the LLM provider catalog, do the following:
- In the sidebar, select LLMs.
- Select the Providers tab.
This tab lists every LLM provider that you can connect in your organization. Click Connect next to a provider to open the Create LLM connection page.
Set the access mode
Access is a setting on the connection, and it applies to the connection on every route:
You set Access in the Connection section when you create a connection. To change it later, open the connection, and then on the Overview tab, select Edit next to Access.
To give callers access to a gated connection, open the connection, select the Access tab, and then select Add grant. In Grant access to, choose who the grant covers:
Next steps
- To add authentication, rate limiting, routing, or transforms to any of these routes, see Control traffic with plugins.
- To monitor traffic on these routes, see Monitor gateway traffic.
- To add an upstream credential for a connection, see Manage credentials and vaults.

