generated from kubernetes/kubernetes-template-project
-
Notifications
You must be signed in to change notification settings - Fork 168
Closed
Labels
help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.kind/cleanupCategorizes issue or PR as related to cleaning up code, process, or technical debt.Categorizes issue or PR as related to cleaning up code, process, or technical debt.
Description
Hermetic test is a fast way to verify functionality e2e without requiring a real cluster.
Add the following cases to make sure the EPP can correctly handle the errors.
- Test when requested model is not found in InferenceModel
- Test InferenceModel has a different InferencePool than the
poolName
flag passed to EPP - this should be the same as the InferenceModel doesn't exist - Test when no backend pods are available
- Test invalid request payload (e.g., doesn't contain "model")
- Test backend server error, client should receive an error with an appropriate error code
Metadata
Metadata
Assignees
Labels
help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.kind/cleanupCategorizes issue or PR as related to cleaning up code, process, or technical debt.Categorizes issue or PR as related to cleaning up code, process, or technical debt.