Error when fine-tune GRPO with Qwen3.5 #8237
Description
Checklist / 检查清单
- I have searched existing issues, and this is a new bug report. / 我已经搜索过现有的 issues，确认这是一个新的 bug report。
Bug Description / Bug 描述
When I try to GRPO fine-tuned Qwen3.5, I encounter this error:
When I check the code of ms-swift
and transformers:
I noticed that the new Qwen3.5 has changed API of get_rope_index function, thus it is missing mm_token_type_ids parameter. Perhaps it need to be fixed.
How to Reproduce / 如何复现
Test on A40, latest transformers, vllm.
Additional Information / 补充信息
No response