Skip to content

Commit c095b1a

Browse files
skyloevilyyihuang
authored andcommitted
Remove redundant row_indices unsqueeze operation in MiniCPMO (#22528)
Signed-off-by: zitian.zhao <[email protected]> Signed-off-by: Avery Yingyi Huang <[email protected]>
1 parent 5ffac4c commit c095b1a

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

vllm/model_executor/models/minicpmo.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -605,7 +605,6 @@ def subsequent_chunk_mask(
605605
max=size)
606606
# Create column indices for broadcasting
607607
col_indices = torch.arange(size, device=device).unsqueeze(0)
608-
row_indices = row_indices.unsqueeze(1)
609608
start_indices = start_indices.unsqueeze(1)
610609
end_indices = end_indices.unsqueeze(1)
611610
# Vectorized mask creation

0 commit comments

Comments
 (0)