Repository navigation
v0.9.1
This release:
- Updates the default vllm install to 0.10.1.1
- Fixes a bug where vlm 0.10.1.1 did not work
- Fixes a bug where FP8 did not work with continuous batching
What's Changed
- 馃悰 fix image by @joerunde in #442
- [CB] optimization: cache volumetric constraint in scheduler by @yannicks1 in #418
- feat: FP8 initial support on continuous batching by @wallashss in #402
- 馃悰 Fix SB max-model-len override by @prashantgupta24 in #436
- 猬嗭笍 bump default vllm version to 0.10.1.1 by @joerunde in #446
Full Changelog: v0.9.0...v0.9.1