Limits and defaults
Fabric AI Gateway applies fixed size caps to the requests and responses it reads, and default timeouts and retry settings to the upstreams it calls. This page lists those values. Limits that you configure yourself, such as rate limits, token budgets, and budgets, are on their own pages: Rate limits and Budgets.
Request and response size
The client always receives the full response body. The caps only limit what the gateway keeps in memory.
Timeouts
Each connection can set its own timeouts. When it doesn’t, the gateway uses these defaults:
The connect, read, and write timeouts each accept 0 to 600,000 milliseconds. A value of 0 means not set.
Retries and failover
For how to configure failover, see Fail over across providers with the LLM Router.
Upstream health
Health checks and the circuit breaker run only on connections that configure them. Without them, the gateway doesn’t take a failing upstream out of rotation. When a connection configures them without setting these values, the gateway uses these defaults:
Connections to upstreams
Streaming
MCP tool lists
Other limits
Next steps
- Look up what each error status means in Gateway error codes.
- Set request and token limits for your callers in Rate limits.
- Size a data plane that you run yourself in Scale and high availability.

