Skip to content

model : fix hunyuan chat template #15114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

stevenkuang-tencent
Copy link
Contributor

fix #14878
Fixed the hunyuan chat-template issue, please use the latest model for inference.

Signed-off-by: stevenkuang <[email protected]>
Copy link
Collaborator

@CISC CISC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixes autodetection, but it looks like there's still some issues with the template itself...

@DamonFool
Copy link

Fixes autodetection, but it looks like there's still some issues with the template itself...

Thanks @CISC for approving.
Since all checks have passed and we need this patch to run the models, can this pr get merged now?
Thanks.

@stevenkuang-tencent
Copy link
Contributor Author

stevenkuang-tencent commented Aug 6, 2025

Fixes autodetection, but it looks like there's still some issues with the template itself...

The latest hunyuan-dense chat-template adds function call feature and cot elimination logic. We plan to support these features in the future, and these issues will not block the use of the model.

@CISC CISC merged commit 2572689 into ggml-org:master Aug 6, 2025
47 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants