Check prefix preservation at the token level#5559

qgallouedec merged 8 commits into

mainhuggingface/trl:mainfrom

check-prefix-preservation-at-the-token-levelhuggingface/trl:check-prefix-preservation-at-the-token-levelCopy head branch name to clipboard