Skip to navigation

Monitor gateway traffic

Fabric AI Gateway records the requests that pass through it in analytics, and in traces when they’re sampled, so you can monitor traffic without instrumenting your own services. Use Analytics to see aggregated metrics such as cost, latency, and error rate across a time window. Use Traces to inspect individual requests down to the plugin and upstream level.

The gateway supports recent OpenTelemetry GenAI conventions for more granular LLM metrics and tracing, helping you inspect model and request activity in greater detail.

Choose between analytics and traces

UseWhen you want toGuide
AnalyticsSee trends in traffic, errors, latency, token usage, and cost.Review analytics
TracesDebug a specific request, or check which model or provider served it.Inspect traces

Analytics and Traces appear in two places. In the main sidebar, they show traffic for the current namespace. Under Admin, they show traffic for your whole organization. If you run your own data plane, Gateway health also appears under Admin.

Next steps