Guardrails supports on SDK

[adarshkr]

Is there a plan to support guardrails on the LiteLLM SDK, similar to the proxy?

[ishaan-jaff]

We can support this - what's the ideal interface you'd want to do this with ?

[adarshkr]

We intend to develop a separate Guardrails Hub, similar to GuardrailsAI Hub, but built using NeMo Guardrails. The idea is to allow invoking these guardrails within the LiteLLM SDK based on configurations.

Would love to hear your thoughts on the best way to integrate this within LiteLLM SDK!

[ayrayane]

I'm very interested in using Guardrails with an SDK rather than the Litellm built-in proxy. Have you found a solution?

[issugo]

Hi, I think there is a lot of people interested by this feature.
Does litellm team intend to work on this ?