train_model model load repaired

[JornyWan]

In the code train_model.py:
model = AutoModelForSeq2SeqLM.from_pretrained(
model_args.model_name_or_path,
from_tf=bool(".ckpt" in model_args.model_name_or_path),
config=config,
cache_dir=model_args.cache_dir,
revision=model_args.model_revision,
use_auth_token=True if model_args.use_auth_token else None,
)
if anyone could not use this to initial a flan-t5 model from AutoModelForSeq2SeqLM, then you need to add the following in params:
unk_token="",
bos_token="",
eos_token=""
Thanks!

[SivilTaram]

@JornyWan Thanks for your feedback and pull request! May I know your transformers version? I have never encountered the problem, not sure if it is the case for the latest transformers library.

[JornyWan]

@SivilTaram thanks for quick response, my transformer version is 4.31.0

[JornyWan]

actually it would be like:

[JornyWan]

@SivilTaram you can just put it to another branch for different version of transformer use if it is the problem with version