Hi, thank you for open-sourcing this model!
When I try to run OctoThinker/OctoThinker-8B-Short-Base, I encounter the following error:
ValueError: Cannot use chat template functions because tokenizer.chat_template is not set and no template argument was passed!
For information about writing templates and setting the tokenizer.chat_template attribute, please see the documentation at:
https://huggingface.co/docs/transformers/main/en/chat_templating
It seems the model does not have a chat_template defined. Could you please clarify:
- Should users manually set a chat template (e.g., by editing
tokenizer.chat_template)?
- Or will you provide an official
chat_template in the model repo?
- If you already have a recommended template, could you add it to the model card or documentation?
Thanks a lot!
Hi, thank you for open-sourcing this model!
When I try to run
OctoThinker/OctoThinker-8B-Short-Base, I encounter the following error:It seems the model does not have a
chat_templatedefined. Could you please clarify:tokenizer.chat_template)?chat_templatein the model repo?Thanks a lot!