Skip to navigation

Tool Search plugin

The Tool Search plugin keeps a large tool catalog out of the client’s context. On a route with Tool Search, tools/list returns three gateway tools instead of the route’s real tools:

  • search_tool ranks the real tools by meaning against a query.
  • get_tool returns one tool’s input schema.
  • execute_tool calls a real tool by name.

The gateway ranks tools with embeddings from an OpenAI-compatible embedding service that you configure.

Where it runs

ProtocolsMCP routes
Scope kindsroute only
PhaseRequest. The MCP handling does the work.

Configuration

result_limit_default
integerDefaults to 10

Results returned when the client doesn’t give a usable limit. At least 1, and not above result_limit_max.

result_limit_max
integerDefaults to 25

The maximum number of results.

summary_max_len
integerDefaults to 120

The maximum characters in each tool summary.

embedder
objectRequired

The embedding service.

embedder.base_url
string

The service’s base URL. The gateway calls POST <base_url>/embeddings with input and model, in the OpenAI format.

embedder.model
string

The embedding model.

embedder.dimension
integerRequired

The vector length the model returns, at least 1. Vectors of any other length count as a failure.

embedder.api_key_ref
string

A named secret reference for the service’s API key, sent as Authorization: Bearer. Raw env:// and file:// references are refused.

embedder.timeout
durationDefaults to 5s

The time limit for each call to the embedding service.

embedder.cold_start_timeout
durationDefaults to 60s

The total time to embed tools that don’t have a vector yet.

embedder.provider
string

Optional. With quantize and cache_scope, it only labels the vector index.

embedder.max_batch
integerDefaults to 256

Tools per embedding call.

Example

{
"name": "tool-search",
"plugin_id": "tool-search",
"scope": { "kind": "route", "name": "workspace-mcp" },
"config": {
"result_limit_default": 5,
"embedder": {
"base_url": "https://embeddings.example.com/v1",
"model": "text-embedding-3-small",
"dimension": 1536,
"api_key_ref": "embedder-api-key"
}
}
}

On an Enterprise data plane, the Helm chart also deploys an embedding service, fabric-gateway-embedder, that serves the BAAI/bge-small-en-v1.5 model with 384 dimensions. For the embedder settings that use it, see Run the tool-search embedder.