Describe the feature

We just had an incident in production as vllm-router still routes to dead nodes, which I did not expect.

LiteLLM could detect this and only route request to the node with healthy state.

Why do you need this feature?

In case a node dies, requests should still be routed to other nodes

Additional context

No response