[Release] Smart Routing (L1) #244
FFengIll
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
We have released smart routing features to empower agent developers and vibe coders.
Unlike standard routing rules, smart routing rules allow for more granular condition checks, directing model interactions to different models dynamically.
Activation
Click the gear icon in the rule configuration to convert the rule to a smart rule and activate smart mode.
The original configuration will be retained as a fallback.
Click the button again to switch back to standard mode.
Configuration
Currently, smart routing configuration supports several operators, including:
Example
When developing with a multi-agent architecture, I often configure specific system prompts for different agents and want to dispatch them to different models.
With tingly-box, I can configure a single model rule and use the
system promptoperator to handle the dispatch automatically.As shown in the image, when the system prompt contains
I am a summary agent, the traffic is routed to the more cost-effective Deepseek.Otherwise, the request is sent to the fallback model, GLM.
Beta Was this translation helpful? Give feedback.
All reactions