WIP: kserve functionality

[cooktheryan]

What type of PR is this?
Allow people to use kserve for the model serving portion when using semantic router

What this PR does / why we need it:
Need to be able to demonstrate this on opendatahub and RHOAI

Which issue(s) this PR fixes:

Fixes #565

Release Notes: Yes

[netlify]

✅ Deploy Preview for vllm-semantic-router ready!

Name	Link
🔨 Latest commit	df28f21
🔍 Latest deploy log	https://app.netlify.com/projects/vllm-semantic-router/deploys/6907bdb0fb6ae50008fde775
😎 Deploy Preview	https://deploy-preview-566--vllm-semantic-router.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify project configuration.

[github-actions]

👥 vLLM Semantic Team Notification

The following members have been identified for the changed files in this PR and have been automatically assigned:

📁 deploy

Owners: @rootfs, @Xunzhuo
Files changed:

• deploy/kserve/README.md
• deploy/kserve/configmap-envoy-config.yaml
• deploy/kserve/configmap-router-config.yaml
• deploy/kserve/deployment.yaml
• deploy/kserve/example-multi-model-config.yaml
• deploy/kserve/inference-examples/README.md
• deploy/kserve/inference-examples/inferenceservice-granite32-8b.yaml
• deploy/kserve/inference-examples/servingruntime-granite32-8b.yaml
• deploy/kserve/kustomization.yaml
• deploy/kserve/pvc.yaml
• deploy/kserve/route.yaml
• deploy/kserve/service.yaml
• deploy/kserve/serviceaccount.yaml
• deploy/kserve/test-semantic-routing.sh

📁 website

Owners: @Xunzhuo, @rootfs, @yuluo-yx
Files changed:

• website/package-lock.json

---

🎉 Thanks for your contributions!

This comment was automatically generated based on the OWNER files in the repository.