LLM Observability plugin
The LLM Observability plugin reads the token usage, response model, and finish reason from each LLM answer that carries them. An OpenAI chat stream carries usage only when the client sets stream_options.include_usage, and answers over 10 MiB aren’t read. For each LLM request, it writes one llm.complete log line on the data plane and, when metering is on and the data plane has a usage writer, one usage record. Other plugins, such as LLM Rate Limit, use the token counts it records.
Where it runs
Your organization can have one instance, and it must be named llm-observability. Attaching it to a route, connection, or consumer is rejected.
Configuration
Each field overrides the data plane’s default for requests that the instance applies to.
Logged bodies can contain prompts and personal data. Add the PII Redaction plugin to scrub them, or leave body logging off.

