Skip to content

Unable to run OctoThinker/OctoThinker-8B-Short-Base due to missing chat_template #6

Description

@YijuGuo

Hi, thank you for open-sourcing this model!

When I try to run OctoThinker/OctoThinker-8B-Short-Base, I encounter the following error:

ValueError: Cannot use chat template functions because tokenizer.chat_template is not set and no template argument was passed! 
For information about writing templates and setting the tokenizer.chat_template attribute, please see the documentation at: 
https://huggingface.co/docs/transformers/main/en/chat_templating

It seems the model does not have a chat_template defined. Could you please clarify:

  1. Should users manually set a chat template (e.g., by editing tokenizer.chat_template)?
  2. Or will you provide an official chat_template in the model repo?
  3. If you already have a recommended template, could you add it to the model card or documentation?

Thanks a lot!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions