How does this auto routing exactly works

[arunkumar-maker]

I have few doubts.
for the first time if the user ask a question, since there context is empty the question will be routed to the right model, later may be because of few complex questions the model got changes to an expensive model, now if the user make a question and as we pass the entire context to the router, will it route the request to the model based on the latest question or based on the entire context ?

[Xunzhuo]

Good question, a short answer is both will be considered, it's based on how you design your mixture of models recipes and use cases

[arunkumar-maker]

I have come across this documentation: https://vllm.ai/blog/2026-06-02-session-aware-agentic-routing
Do we need to implement SAAR in the policy to take the decision based on the entire session rather than the latest question?
Please explain