Update Special Language Tokens for PLBART#19980

Merged

sgugger merged 11 commits intohuggingface:mainfrom

jordiclive:plbart_tok

Nov 21, 2022

Commits on Oct 31, 2022

Update Special Language Tokens for PLBART
jordiclive
committed
fix format
jordiclive
committed

Commits on Nov 3, 2022

making mapping for language codes and updating tests:
jordiclive
committed
fix format
jordiclive
committed
fix consistency
jordiclive
committed

Commits on Nov 4, 2022

add assert to both tokenizer tests.
jordiclive
committed
fix format
jordiclive
committed

Commits on Nov 15, 2022

Update src/transformers/models/plbart/tokenization_plbart.py

jordiclive
and
ArthurZucker
authored
improvin readability, setting self.tgt_lang
jordiclive
committed
fixing
jordiclive
committed

Commits on Nov 17, 2022

readability
jordiclive
committed