Numerical Folder:
Supporting Models: Transformer, Informer, Autoformer with different temporal embeddings
HuggingFace_EncDec Folder:
Supporting Models: BERT, Electra, RoBERTa
HuggingFace_Generation Folder:
Supporting Models: Bart, Blenderbot, LED, Pegasus, ProphetNet, Bigbird, T5
The Pre-trained Models for HuggingFace Language Models can be accessed as follows:
| Model name | HuggingFace Model |
|---|---|
| T5 | t5-base |
| Bart | facebook/bart-base |
| Blenderbot | facebook/blenderbot-small-90M |
| LED | allenai/led-base-16384 |
| Pegasus | google/pegasus-xsum |
| ProphetNet | microsoft/prophetnet-large-uncased |
| Bigbird | google/bigbird-pegasus-large-arxiv |
| Electra | google/electra-base-generator |
| BERT | bert-base-uncased |
| RoBERTa | roberta-base |
Core Packages:
transformers == 4.17.0
torch == 1.10.2