[CodeLlamaTokenizer] Nit, update __init__ to make sure the AddedTokens are not normalized because they are special#27359
Merged
ArthurZucker merged 4 commits intomainfrom Nov 9, 2023
Merged
Commits
Commits on Nov 8, 2023
Commits on Nov 9, 2023
- committed
- committed
- committed