Skip to navigation

The console lists each provider that your organization can connect under LLMs > Providers. This topic covers providers that don’t have their own page. For the setup steps, see Connect an LLM provider.

Provider summary

ProviderAPI formatCredentialsNotes
Google Vertex AISet by the provider catalogA Google Cloud service account key (JSON). On the Enterprise plan, the data plane’s own Google Cloud identity also works.The gateway gets a Google OAuth access token and sends it as Authorization: Bearer. The console asks for your Project ID and region and puts them in the target URL.
Any provider with an OpenAI-compatible APIOpenAI-compatible APIBearer token or API keyConnect it with a manual connection. See Connect an OpenAI-compatible or self-hosted model server.
Any provider with an Anthropic Messages APIAnthropic Messages APIAPI keyConnect it with a manual connection. See Connect an OpenAI-compatible or self-hosted model server.

What every provider has in common

  • The gateway forwards requests in the format the client sent. It doesn’t translate between the OpenAI and Anthropic formats.
  • The gateway sends the model field unchanged. There’s no mapping from one provider’s model names to another’s.
  • The gateway adds the provider credential that you set up, and removes the caller’s gateway key before it forwards the request.
  • A route can combine several connections, even from different providers, as long as they don’t declare the same path with different formats. For how to use this, see Fail over across providers.

Next steps