New Features
Explore the new features introduced in this release.
Adaptive model routing
The Adaptive Model Router plugin rates each prompt with a decision service and sends it to the model that fits its difficulty, which helps reduce LLM spend. You bring your own decision service. For the steps, see Adaptive Model Routing and Provider Failover.
Fallback routing and LLM Router modes
The LLM Router plugin offers the single, fallback, and loadbalance modes. In fallback mode, you list services in priority order, so that a request that fails on one service moves to the next. For the steps, see Adaptive Model Routing and Provider Failover.
Switch organizations without signing out
If you belong to more than one organization, you can switch between them from the menu at the bottom of the sidebar. For the steps, see Administer your organization.