Skip to content

Pull requests: vllm-project/vllm

New pull request New
842 Open 10,197 Closed
842 Open 10,197 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Fix eviction cached blocked logic performance Performance-related issues v1
#21357 opened Jul 22, 2025 by simon-mo Loading…
1
[Misc] unify variable for LLM instance v2
#21356 opened Jul 22, 2025 by andyxning Loading…
4 tasks
8
[CI/Build][Doc] Move existing benchmark scripts in CI/document/example to vllm bench CLI ci/build documentation Improvements or additions to documentation performance Performance-related issues tpu Related to Google TPUs
#21355 opened Jul 22, 2025 by yeqcharlotte Loading…
4 tasks done
1
2
[xpu] disable cudagraph for xpu platform
#21354 opened Jul 22, 2025 by chaojun-zhang • Draft
4 tasks
3
Decode Tokenized IDs to Strings for hf_processor in llm.chat() with model_impl=transformers
#21353 opened Jul 22, 2025 by ariG23498 Loading…
8
[Core][Feat] Add max-waiting-queue-length parameter to reject requests when waiting queue is full frontend v1
#21352 opened Jul 22, 2025 by chaunceyjiang Loading…
3 of 4 tasks
9
[Core] Minor comments and asserts changes in block pool v1
#21351 opened Jul 22, 2025 by Jialin Loading…
3 of 4 tasks
3
[AMD][BugFix] Fix omission of wvSplitK kernel due to torch.compile rocm Related to AMD ROCm
#21350 opened Jul 22, 2025 by rasmith Loading…
3
[Misc] Remove deprecated args in v0.10 documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed speculative-decoding
#21349 opened Jul 22, 2025 by kebe7jun Loading… v0.10.0
5
[Core] Guided decoding v0 deprecation ci/build frontend structured-output v1
#21347 opened Jul 22, 2025 by rzabarazesh • Draft
1 of 4 tasks
3
[Speculative Decoding] Add speculators Config Support
#21345 opened Jul 22, 2025 by dsikka • Draft
7
[CI] Unifying Dockerfiles for ARM and X86 Builds ci/build documentation Improvements or additions to documentation
#21343 opened Jul 22, 2025 by kebe7jun Loading…
3 of 4 tasks
4
[V1] port xformers backend to v1 v1
#21342 opened Jul 22, 2025 by TheEpicDolphin • Draft
4
Add anthropic endpoint documentation Improvements or additions to documentation frontend tool-calling v1
#21341 opened Jul 22, 2025 by SriRangaTarun • Draft
6
[TPU][Bugfix] fix moe layer tpu Related to Google TPUs v1
#21340 opened Jul 22, 2025 by yaochengji Loading…
4
Support DeepSeekV3-style block FP8 quantization with CT deepseek Related to DeepSeek models
#21337 opened Jul 21, 2025 by mgoin Loading…
2
[Refactor] Remove moe_align_block_size_triton performance Performance-related issues
#21335 opened Jul 21, 2025 by yewentao256 Loading…
7
Add think chunk deepseek Related to DeepSeek models frontend
#21333 opened Jul 21, 2025 by juliendenize Loading…
3
[Kernel] adding fused_moe configs for upcoming granite4
#21332 opened Jul 21, 2025 by bringlein • Draft
3 of 4 tasks
7
Support Tensorrt-LLM MoE fp4 for low-latency
#21331 opened Jul 21, 2025 by wenscarl • Draft
4 tasks
6
Adds parallel model weight loading for runai_streamer ci/build
#21330 opened Jul 21, 2025 by bbartels Loading…
4 tasks
5
[Core] Convert EngineCoreRequest to Request before reaching the engine core … v1
#21329 opened Jul 21, 2025 by Jialin Loading…
3 of 4 tasks
11
[P/D] Move FakeNixlWrapper to test dir ready ONLY add when PR is ready to merge/full CI is needed v1
#21328 opened Jul 21, 2025 by ruisearch42 Loading…
3 of 4 tasks
@njhill @kouroshHakha
7
Fix Flashifner Allreduce+Norm enable disable calculation based on fi_allreduce_fusion_max_token_num
#21325 opened Jul 21, 2025 by xinli-git Loading…
3 tasks done
6
[Misc] Add dummy maverick test to CI ci/build multi-modality Related to multi-modality (#4194)
#21324 opened Jul 21, 2025 by minosfuture Loading…
7
ProTip! Mix and match filters to narrow down what you’re looking for.