Skip to content

[BUGFIX][v0.9.1] ep_group is not equal to word_size in some cases. #1862

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Jul 18, 2025

Conversation

weijinqian0
Copy link
Contributor

[BUGFIX][v0.9.1] ep_group is not equal to word_size in some cases. for examples: external_dp.

Signed-off-by: weijinqian_v1 <[email protected]>
@ganyi1996ppo ganyi1996ppo merged commit da006cb into vllm-project:v0.9.1-dev Jul 18, 2025
16 checks passed
NNUCJ pushed a commit to NNUCJ/vllm-ascend that referenced this pull request Jul 21, 2025
…llm-project#1862)

[BUGFIX][v0.9.1] ep_group is not equal to word_size in some cases. for
examples: external_dp.

---------

Signed-off-by: weijinqian_v1 <[email protected]>
Co-authored-by: weijinqian_v1 <[email protected]>
845473182 added a commit to 845473182/vllm-ascend that referenced this pull request Jul 23, 2025
* br_eplb_into_v091: (29 commits)
  add eplb design doc
  merge update in eplb branch
  dynamic eplb
  [0.9.1][Perf] Use fused ops npu_top_k_top_p (vllm-project#1920)
  [0.9.1][PD][Perf] Avoid performing cpu all_reduce in disaggregated-prefill scenario. (vllm-project#1644)
  [0.9.1][BugFix] Fix bug in path_decorator when engine v0 (vllm-project#1919)
  [0.9.1][Perf] apply npu_moe_gating_top_k_softmax for moe (vllm-project#1902)
  [0.9.1][bugfix] W4A8 does not currently support apply_mlp_decode (vllm-project#1910)
  [0.9.1][CI] Pin vllm version to v0.9.1 to make mypy check passed (vllm-project#1904)
  [0.9.1][Dist][Bugfix] Fix mc2 process group to resolve self.cpu_group is None (vllm-project#1831)
  [0.9.1][Perf]Remove NZ of kv_b_proj in Deepseek MLA. (vllm-project#1872)
  [0.9.1][bugfix] V0.9.1 fix rope accruracy bug for deepseek model (vllm-project#1887)
  [0.9.1] Fix wheel glibc version incompatibility (vllm-project#1808)
  [BUGFIX][v0.9.1] repair moe error when set multistream. (vllm-project#1882)
  [BUGFIX][v0.9.1] ep_group is not equal to word_size in some cases. (vllm-project#1862)
  [BUGFIX][v0.9.1] fix enable_multistream_moe bug when DBO is enabled (… (vllm-project#1827)
  [0.9.1]optmize rope in qwen2 (vllm-project#1782)
  [BugFix] Fix flashcomm_v1 when engine v0 (vllm-project#1859)
  [BugFix] Fix decorator patch (vllm-project#1858)
  [0.9.1][Fix] Fix DeepSeek OOM issue in extreme `--gpu-memory-utilization` scenario (vllm-project#1829)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants