Dynamic routing based on privacy requirements

[fnordian]

I would like to query documents using Newelle, but I hesitate using external model providers for that. I do have hardware capable of running models locally, but they are slow. So I would like to dynamically and automically route privacy sensitive conversations to a local model, and all other to a fast external one.

[FrancescoCaracciolo]

Just use different profiles

[su92-bscsm-f24-584-tech]

i have question what the model it use, i check demo and the question, i want to ask what demo newelle call by api, i asked not demo model but which mlp you built if their is