> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.fabricgateway.ai/configure/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.fabricgateway.ai/_mcp/server. # Configure the gateway > Find the right topic for connecting providers, routing and securing traffic, monitoring requests, and managing access in Fabric AI Gateway. You configure Fabric AI Gateway in the console, or with the admin API. The topics are grouped by what you want to do, in roughly the order that a first setup follows. If you haven't used the console yet, start with [Explore the console](/get-started/console). ## Connect and route #### [Connections](/configure/connections) Connect and manage LLM providers, MCP servers, and REST APIs, and review the routes that expose them. #### [Providers](/configure/providers/openai) Set up OpenAI, Anthropic, Amazon Bedrock, Azure OpenAI, Google Gemini, or a self-hosted model as an LLM provider. #### [Credentials](/configure/credentials) Manage the credentials that the gateway uses, and understand where secrets are stored on cloud and enterprise tenants. #### [LLM routing](/configure/routing) Compare the routing plugins that choose a model for each LLM request or fail over across providers. ## Govern and secure #### [Key Auth](/configure/authentication/key-auth) Require a gateway key on a route, choose the header that carries it, and troubleshoot authentication errors. #### [JWT Auth](/configure/authentication/jwt-auth) Authenticate callers with JSON Web Tokens from your identity provider, and use token claims to control which tools an agent can use. #### [Model access](/configure/access-and-limits/model-access) Limit which models a connection serves, and which users can use a connection and its tools. #### [Rate limits](/configure/access-and-limits/rate-limits) Cap how many requests or LLM tokens a caller can use in a time window, and what clients get when they reach the limit. #### [Budgets](/configure/access-and-limits/budgets) Set a spending budget for your organization or a namespace, adjust costs for your provider discounts, cap what you pay Fabric, and cap token use per caller. #### [Plugins](/configure/plugins) Secure, transform, observe, and control the cost of LLM, MCP, and HTTP API traffic with plugins. ## Administer your organization #### [Admin](/configure/organization) Understand the roles that control access to your organization and its namespaces, how cloud and enterprise tenants differ, and where to review activity and billing. ## Manage with the API #### [Admin API](/configure/automation/admin-api) Call the Fabric AI Gateway admin API with an API key to create connections, routes, and plugin instances from scripts and pipelines. #### [API keys](/configure/automation/api-keys) Create admin API keys to manage your Fabric AI Gateway organization programmatically. ## Docs - [Manage connections and routes](https://docs.fabricgateway.ai/configure/connections.md): Connect and manage LLM providers, MCP servers, and REST APIs, and review the routes that expose them. - [Connect an LLM provider](https://docs.fabricgateway.ai/configure/connections/llm-providers.md): Connect an LLM provider, create a route for it, and create a gateway key for callers. - [Connect to a provider over a private network](https://docs.fabricgateway.ai/configure/connections/private-connections.md): Send LLM traffic to a provider through Fabric's private endpoint instead of the public internet, and set up the AWS role that Fabric assumes. - [Connect an MCP server](https://docs.fabricgateway.ai/configure/connections/mcp-servers.md): Create an MCP server connection, add upstreams, and set the access mode. - [Connect a REST API](https://docs.fabricgateway.ai/configure/connections/rest-apis.md): Connect a REST API as a connection, either manually or by importing an OpenAPI spec that generates its routes. - [Connect OpenAI](https://docs.fabricgateway.ai/configure/providers/openai.md): Target URL, credentials, supported endpoints, and model names for an OpenAI connection. - [Connect Anthropic](https://docs.fabricgateway.ai/configure/providers/anthropic.md): Target URL, credentials, supported endpoints, and model names for an Anthropic connection. - [Connect Amazon Bedrock](https://docs.fabricgateway.ai/configure/providers/amazon-bedrock.md): Target URLs, AWS credentials, supported endpoints, and model IDs for Amazon Bedrock and Amazon Bedrock Mantle connections. - [Connect Azure OpenAI](https://docs.fabricgateway.ai/configure/providers/azure-openai.md): Target URL, credentials, supported endpoints, and deployment names for an Azure OpenAI connection. - [Connect Google Gemini](https://docs.fabricgateway.ai/configure/providers/google-gemini.md): Target URL, credentials, supported endpoints, and model names for a Google Gemini AI Studio connection. - [Connect an OpenAI-compatible or self-hosted model server](https://docs.fabricgateway.ai/configure/providers/openai-compatible.md): Connect any server that implements the OpenAI or Anthropic Messages API, including models you host yourself. - [Other LLM providers](https://docs.fabricgateway.ai/configure/providers/other-providers.md): How to connect LLM providers that don't have their own page, including Google Vertex AI. - [Manage credentials and vaults](https://docs.fabricgateway.ai/configure/credentials.md): Manage the credentials that the gateway uses, and understand where secrets are stored on cloud and enterprise tenants. - [Route LLM requests across models and providers](https://docs.fabricgateway.ai/configure/routing.md): Compare the routing plugins that choose a model for each LLM request or fail over across providers. - [Choose a routing approach](https://docs.fabricgateway.ai/configure/routing/choose-an-approach.md): Compare the model router, the LLM Router, and the Adaptive Model Router, and pick the one that fits a route. - [Route requests by model name](https://docs.fabricgateway.ai/configure/routing/model-router.md): Serve many providers and models from one route, and let clients pick one by naming it as provider/model. - [Define model aliases](https://docs.fabricgateway.ai/configure/routing/aliases.md): Give clients a plain model name that maps to one or more providers, and retarget it without changing any client. - [Route requests with the Adaptive Model Router](https://docs.fabricgateway.ai/configure/routing/adaptive-routing.md): Rate each LLM request with a decision service and send it to the model that fits its difficulty. - [Fail over across providers with the LLM Router](https://docs.fabricgateway.ai/configure/routing/failover.md): List connections in priority order so that a request that fails on one provider moves to the next. - [Route requests through Lightyear](https://docs.fabricgateway.ai/configure/routing/lightyear.md): Use the Lightyear mode of the LLM Router plugin to route requests through Lightyear and reduce LLM spend. - [Authenticate requests with Key Auth](https://docs.fabricgateway.ai/configure/authentication/key-auth.md): Require a gateway key on a route, choose the header that carries it, and troubleshoot authentication errors. - [Authenticate requests with JWT Auth](https://docs.fabricgateway.ai/configure/authentication/jwt-auth.md): Authenticate callers with JSON Web Tokens from your identity provider, and use token claims to control which tools an agent can use. - [Restrict model and tool access](https://docs.fabricgateway.ai/configure/access-and-limits/model-access.md): Limit which models a connection serves, and which users can use a connection and its tools. - [Limit requests and tokens](https://docs.fabricgateway.ai/configure/access-and-limits/rate-limits.md): Cap how many requests or LLM tokens a caller can use in a time window, and what clients get when they reach the limit. - [Control spend with budgets](https://docs.fabricgateway.ai/configure/access-and-limits/budgets.md): Set a spending budget for your organization or a namespace, adjust costs for your provider discounts, cap what you pay Fabric, and cap token use per caller. - [Control traffic with plugins](https://docs.fabricgateway.ai/configure/plugins.md): Secure, transform, observe, and control the cost of LLM, MCP, and HTTP API traffic with plugins. - [Administer your organization](https://docs.fabricgateway.ai/configure/organization.md): Understand the roles that control access to your Fabric AI Gateway organization and its namespaces, how cloud and enterprise tenants differ, and where to review activity and billing. - [Manage users and invitations](https://docs.fabricgateway.ai/configure/organization/users.md): Review users, invite people, check pending invitations, and change a user's role. - [Manage namespaces](https://docs.fabricgateway.ai/configure/organization/namespaces.md): Give each team its own space for routes, connections, credentials, analytics, traces, and people within one organization, and track what each team spends. - [Configure the gateway with the admin API](https://docs.fabricgateway.ai/configure/automation/admin-api.md): Call the Fabric AI Gateway admin API with an API key to create connections, routes, and plugin instances from scripts and pipelines. - [Manage API keys](https://docs.fabricgateway.ai/configure/automation/api-keys.md): Create admin API keys to manage your Fabric AI Gateway organization programmatically.