Transformer models

[flozi00]

Is your feature request related to a problem? Please describe.
Low ressource languages and deep domain use cases need more efficient models

Describe the solution you'd like
Huggingface is working in their transformers library integrating ASR models like wave2vec 2 and speech transformer

Describe alternatives you've considered
The fairseq implementation of wave2vec has more dependencies and is more complex to use and less readable.

Additional context
Integrating huggingface models makes have you pretrained models from modelhub, multiple models support with less code.

[robin1001]

Thanks, we will investigate on that

[xingchensong]

#1683 OnGoing