A generation issue: when ignore_eos=False and the model's pad_token==eos_t…#1539

Closed

YunLiu1 wants to merge 1 commit into

huggingface:mainfrom

Commits on Dec 2, 2024

For the issue: when ignore_eos=False and the model's pad_token==eos_token (like Llama3), the generated results in same batch size erased.
YunLiu1
committed