From e7b2f5b6f3e06bca2aaf696e9ad2e09e52202a22 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 19:48:37 +0100 Subject: [PATCH 01/28] Improve the table with validated models --- README.md | 24 ++++++++++++------------ 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/README.md b/README.md index 9178d75947..4585a6f70a 100644 --- a/README.md +++ b/README.md @@ -211,18 +211,18 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ ## Validated Models The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: -| | Text Classification | Question Answering | Language Modeling | Summarization | Translation | Image Classification | Audio Classification | Speech Recognition | Single Card | Multi Card | DeepSpeed | -|------------|:-------------------:|:------------------:|:------------------:|:------------------:|:-----------------:|:--------------------:|:--------------------:|:------------------:|:------------------:|:-----------------:|:------------------:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| RoBERTa | ✗ | :heavy_check_mark: | :heavy_check_mark: | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| ALBERT | ✗ | :heavy_check_mark: | :heavy_check_mark: | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| DistilBERT | ✗ | :heavy_check_mark: | :heavy_check_mark: | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| GPT2 | ✗ | ✗ | :heavy_check_mark: | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| T5 | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| ViT | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| Swin | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| Wav2Vec2 | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | -| Stable Diffusion | | | | | | | | | :heavy_check_mark: | ✗ | ✗ | +| Architecture | Single Card | Multi Card | DeepSpeed | Tasks | +|--------------|:-----------:|:----------:|:---------:|:-----:| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
| +| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
| Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From aeb96a884ae1169659a97e6c453802186f35fb05 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 19:55:18 +0100 Subject: [PATCH 02/28] Remove margin bottom in bullet list --- README.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 4585a6f70a..2380aabd0f 100644 --- a/README.md +++ b/README.md @@ -213,16 +213,16 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| -| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| -| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| +| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| +| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From e37153702d6f0daf6d753fe7a222f8ae83bc2c1f Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:00:28 +0100 Subject: [PATCH 03/28] Fix margin bottom --- README.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 2380aabd0f..a4b46021fe 100644 --- a/README.md +++ b/README.md @@ -213,16 +213,16 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| -| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| -| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| +| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| +| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From 79f99b1cded22b9ce60fc1dfb314dde90ae47636 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:03:07 +0100 Subject: [PATCH 04/28] Fix --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index a4b46021fe..c8baf36d38 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 267babf947e24857668012227b06c317e3dbbbc1 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:06:01 +0100 Subject: [PATCH 05/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index c8baf36d38..52be9d048b 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 1d977bf7f74ca8be56023af64a58abce0151a97e Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:06:43 +0100 Subject: [PATCH 06/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 52be9d048b..9bcf5526c4 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From bb1db3a3adb52eec79e8df3d6205a211b5e90f59 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:08:14 +0100 Subject: [PATCH 07/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 9bcf5526c4..7a7df9854d 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From b63ea37e4687f5b2863c78828a69eb91b22af6c2 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:10:57 +0100 Subject: [PATCH 08/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 7a7df9854d..43c7e21575 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 2a87bf4b7aff046af7281ec8fd0609fb7a73027d Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:11:18 +0100 Subject: [PATCH 09/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 43c7e21575..c201effa43 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 0f822ab47215fb496e28c06c2516da9329718f01 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:11:47 +0100 Subject: [PATCH 10/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index c201effa43..a0fbb66fc3 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
aaa| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 88fb8f82dc7c72e30d20c71001d81d9d6cb97981 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:12:20 +0100 Subject: [PATCH 11/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index a0fbb66fc3..0285eda1d6 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From a107617be2cc88d5ee0b80df2d1e4147dc93bbb9 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:12:55 +0100 Subject: [PATCH 12/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0285eda1d6..1da59d88b0 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 601b70f16d1219a216fecba01acb77854bdca480 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:15:09 +0100 Subject: [PATCH 13/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 1da59d88b0..5cbd97a225 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 6f0d399995f6c231fa83034f1c0d1e75180a67d2 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:15:32 +0100 Subject: [PATCH 14/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 5cbd97a225..9d0460f3f1 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From d568d6509ed8badcba812a3060dbaa417d2cbe15 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:16:40 +0100 Subject: [PATCH 15/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 9d0460f3f1..9e530760f2 100644 --- a/README.md +++ b/README.md @@ -214,7 +214,7 @@ The following model architectures, tasks and device distributions have been vali | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| | BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 07cedc4281f4d0d3dfcec5a9aa20ce31bec078e4 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:24:20 +0100 Subject: [PATCH 16/28] Fix --- README.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 9e530760f2..2380aabd0f 100644 --- a/README.md +++ b/README.md @@ -213,16 +213,16 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed | Tasks | |--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| -| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| -| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| +| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| +| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From a5c2b42bead89660fabb4157a61397fe6ec7d261 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:26:40 +0100 Subject: [PATCH 17/28] Debug --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 2380aabd0f..55e4f04872 100644 --- a/README.md +++ b/README.md @@ -211,9 +211,9 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ ## Validated Models The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: -| Architecture | Single Card | Multi Card | DeepSpeed | Tasks | -|--------------|:-----------:|:----------:|:---------:|:-----:| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| Architecture | Single Card | Multi Card | DeepSpeed |
Tasks
| +|--------------|:-----------:|:----------:|:---------:|-----| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| From 2731a0eb1aeebcd3aecaa7d4d049b849fffb450f Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:29:13 +0100 Subject: [PATCH 18/28] Fix --- README.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 55e4f04872..d6175e3fcf 100644 --- a/README.md +++ b/README.md @@ -212,17 +212,17 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed |
Tasks
| -|--------------|:-----------:|:----------:|:---------:|-----| +|--------------|:-----------:|:----------:|:---------:|------------------------| | BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| -| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| -| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| -| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| -| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| +| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
| +| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
| +| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
| +| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
| Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From d8ba16cd0da6b40b2d61024f6fc9da75259124bf Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:30:26 +0100 Subject: [PATCH 19/28] Debug --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index d6175e3fcf..823c666668 100644 --- a/README.md +++ b/README.md @@ -213,7 +213,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: | Architecture | Single Card | Multi Card | DeepSpeed |
Tasks
| |--------------|:-----------:|:----------:|:---------:|------------------------| -| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
| +| BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | | RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | | ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | | DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | From 4e80943ba289bf5df74320a1de3d57f1afd2fb38 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:31:58 +0100 Subject: [PATCH 20/28] Fix --- README.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/README.md b/README.md index 823c666668..97a234d4cd 100644 --- a/README.md +++ b/README.md @@ -214,15 +214,15 @@ The following model architectures, tasks and device distributions have been vali | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |--------------|:-----------:|:----------:|:---------:|------------------------| | BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
    • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    | -| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    | -| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    | -| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
    • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
    • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    | -| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
    • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    | +| RoBERTa | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| ALBERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| DistilBERT |:heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| GPT2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| T5 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | +| ViT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +| Swin | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +| Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | +| Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From d868ae7764f512bf5884f202873bf6c2f234bd15 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 20:50:11 +0100 Subject: [PATCH 21/28] Fix table in doc --- docs/source/index.mdx | 24 ++++++++++++------------ examples/audio-classification/README.md | 2 +- examples/image-classification/README.md | 2 +- examples/language-modeling/README.md | 2 +- examples/question-answering/README.md | 2 +- examples/stable-diffusion/README.md | 18 +++++++++++++++++- examples/summarization/README.md | 2 +- examples/text-classification/README.md | 2 +- examples/translation/README.md | 2 +- 9 files changed, 36 insertions(+), 20 deletions(-) diff --git a/docs/source/index.mdx b/docs/source/index.mdx index 0f01a8ac85..dfabae0d4e 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -22,18 +22,18 @@ limitations under the License. The table below shows which model architectures, tasks and device distributions are currently supported for 🤗 Optimum Habana: -| | Text Classification | Question Answering | Language Modeling | Summarization | Translation | Image Classification | Audio Classification | Speech Recognition | Single Card | Multi Card | DeepSpeed | -|--------------------|:-------------------:|:------------------:|:------------------:|:-------------:|:-----------:|:--------------------:|:--------------------:|:------------------:|:-----------:|:----------:|:---------:| -| BERT | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | -| RoBERTa | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | -| ALBERT | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | -| DistilBERT | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | -| GPT2 | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | -| T5 | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | -| ViT | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | -| Swin | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | -| Wav2Vec2 | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | -| Stable Diffusion | | | | | | | | | ✅ | ❌ | ❌ | +| Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | +|------------------|:-----------:|:----------:|:---------:|------------------------| +| BERT | ✅ | ✅ | ✅ |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| RoBERTa | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| ALBERT | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| DistilBERT | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| GPT2 | ✅ | ✅ | ✅ |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| T5 | ✅ | ✅ | ✅ |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | +| ViT | ✅ | ✅ | ✅ |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +| Swin | ✅ | ✅ | ✅ |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +| Wav2Vec2 | ✅ | ✅ | ✅ |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | +| Stable Diffusion | ✅ | ❌ | ❌ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. diff --git a/examples/audio-classification/README.md b/examples/audio-classification/README.md index 4313fcdf47..af24bf609c 100644 --- a/examples/audio-classification/README.md +++ b/examples/audio-classification/README.md @@ -14,7 +14,7 @@ See the License for the specific language governing permissions and limitations under the License. --> -# Audio classification examples +# Audio Classification Examples The following examples showcase how to fine-tune `Wav2Vec2` for audio classification on Habana Gaudi. diff --git a/examples/image-classification/README.md b/examples/image-classification/README.md index 7858e504c6..7f2ed116d0 100644 --- a/examples/image-classification/README.md +++ b/examples/image-classification/README.md @@ -14,7 +14,7 @@ See the License for the specific language governing permissions and limitations under the License. --> -# Image classification examples +# Image Classification Examples This directory contains a script that showcases how to fine-tune any model supported by the [`AutoModelForImageClassification` API](https://huggingface.co/docs/transformers/main/en/model_doc/auto#transformers.AutoModelForImageClassification) (such as [ViT](https://huggingface.co/docs/transformers/main/en/model_doc/vit) or [Swin Transformer](https://huggingface.co/docs/transformers/main/en/model_doc/swin)) on HPUs. They can be used to fine-tune models on both [datasets from the hub](#using-datasets-from-hub) as well as on [your own custom data](#using-your-own-data). diff --git a/examples/language-modeling/README.md b/examples/language-modeling/README.md index 287160b498..3ce63d8c2b 100644 --- a/examples/language-modeling/README.md +++ b/examples/language-modeling/README.md @@ -14,7 +14,7 @@ See the License for the specific language governing permissions and limitations under the License. --> -# Language model training +# Language Model Training Fine-tuning (or training from scratch) the library models for language modeling on a text dataset. GPT-2 is trained or fine-tuned using a causal language modeling (CLM) loss while ALBERT, BERT, DistilBERT and RoBERTa are trained or fine-tuned using a masked language modeling (MLM) loss. You can find more information about the differences between those objectives in our [model summary](https://huggingface.co/transformers/model_summary.html). diff --git a/examples/question-answering/README.md b/examples/question-answering/README.md index 871bd64e1f..44739ca6a4 100644 --- a/examples/question-answering/README.md +++ b/examples/question-answering/README.md @@ -14,7 +14,7 @@ See the License for the specific language governing permissions and limitations under the License. --> -# SQuAD +# Question Answering Examples on SQuAD Based on the script [`run_qa.py`](https://github.com/huggingface/transformers/blob/main/examples/pytorch/question-answering/run_qa.py). diff --git a/examples/stable-diffusion/README.md b/examples/stable-diffusion/README.md index 53aa787dbe..44ce29c8b8 100644 --- a/examples/stable-diffusion/README.md +++ b/examples/stable-diffusion/README.md @@ -1,4 +1,20 @@ -# Stable Diffusion + + +# Stable Diffusion Examples This directory contains a script that showcases how to perform text-to-image generation using Stable Diffusion on Habana Gaudi. diff --git a/examples/summarization/README.md b/examples/summarization/README.md index a21751151b..600484ef36 100644 --- a/examples/summarization/README.md +++ b/examples/summarization/README.md @@ -14,7 +14,7 @@ See the License for the specific language governing permissions and limitations under the License. --> -# Summarization +# Summarization Examples This directory contains examples for finetuning and evaluating transformers on summarization tasks. diff --git a/examples/text-classification/README.md b/examples/text-classification/README.md index 7fd903146f..66017bd5dd 100644 --- a/examples/text-classification/README.md +++ b/examples/text-classification/README.md @@ -14,7 +14,7 @@ See the License for the specific language governing permissions and limitations under the License. --> -# Text classification examples +# Text Classification Examples ## GLUE tasks diff --git a/examples/translation/README.md b/examples/translation/README.md index 17e19ce7f6..2a4f5600ff 100644 --- a/examples/translation/README.md +++ b/examples/translation/README.md @@ -14,7 +14,7 @@ See the License for the specific language governing permissions and limitations under the License. --> -# Translation +# Translation Examples `run_translation.py` is a lightweight example of how to download and preprocess a dataset from the [🤗 Datasets](https://github.com/huggingface/datasets) library or use your own files (jsonlines or csv), then fine-tune one of the architectures above on it. From 917c879a798f18d5e96883757c1e988ef3ca343f Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 22:59:54 +0100 Subject: [PATCH 22/28] Fix --- docs/source/index.mdx | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/docs/source/index.mdx b/docs/source/index.mdx index dfabae0d4e..32dd1ec5ab 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -24,16 +24,16 @@ The table below shows which model architectures, tasks and device distributions | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |------------------|:-----------:|:----------:|:---------:|------------------------| -| BERT | ✅ | ✅ | ✅ |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -| RoBERTa | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -| ALBERT | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -| DistilBERT | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -| GPT2 | ✅ | ✅ | ✅ |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -| T5 | ✅ | ✅ | ✅ |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | -| ViT | ✅ | ✅ | ✅ |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | -| Swin | ✅ | ✅ | ✅ |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | -| Wav2Vec2 | ✅ | ✅ | ✅ |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | -| Stable Diffusion | ✅ | ❌ | ❌ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | +| BERT | ✅ | ✅ | ✅ |
    • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | +| RoBERTa | ✅ | ✅ | ✅ |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | +| ALBERT | ✅ | ✅ | ✅ |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | +| DistilBERT | ✅ | ✅ | ✅ |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | +| GPT2 | ✅ | ✅ | ✅ |
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | +| T5 | ✅ | ✅ | ✅ |
    • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
    • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    | +| ViT | ✅ | ✅ | ✅ |
    • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    | +| Swin | ✅ | ✅ | ✅ |
    • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    | +| Wav2Vec2 | ✅ | ✅ | ✅ |
    • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
    • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    | +| Stable Diffusion | ✅ | ❌ | ❌ |
    • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    | Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From 58b9740a67d42d9353c61f5e8bfb844fe24ab6b0 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 23:11:50 +0100 Subject: [PATCH 23/28] Fix --- docs/source/index.mdx | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/docs/source/index.mdx b/docs/source/index.mdx index 32dd1ec5ab..b5d8693129 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -24,16 +24,16 @@ The table below shows which model architectures, tasks and device distributions | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |------------------|:-----------:|:----------:|:---------:|------------------------| -| BERT | ✅ | ✅ | ✅ |
    • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| RoBERTa | ✅ | ✅ | ✅ |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| ALBERT | ✅ | ✅ | ✅ |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| DistilBERT | ✅ | ✅ | ✅ |
    • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| GPT2 | ✅ | ✅ | ✅ |
    • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    | -| T5 | ✅ | ✅ | ✅ |
    • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
    • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    | -| ViT | ✅ | ✅ | ✅ |
    • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    | -| Swin | ✅ | ✅ | ✅ |
    • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    | -| Wav2Vec2 | ✅ | ✅ | ✅ |
    • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
    • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    | -| Stable Diffusion | ✅ | ❌ | ❌ |
    • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    | +|
    BERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    RoBERTa
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    ALBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    DistilBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    GPT2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    T5
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | +|
    ViT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +|
    Swin
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +|
    Wav2Vec2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | +|
    Stable Diffusion
    |
    ✅
    |
    ❌
    |
    ❌
    |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From 67453bfa0d47bfb330a1f9976cae3e49fc6ae943 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 23:26:38 +0100 Subject: [PATCH 24/28] Fix --- docs/source/index.mdx | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/docs/source/index.mdx b/docs/source/index.mdx index b5d8693129..ea68a32794 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -24,16 +24,16 @@ The table below shows which model architectures, tasks and device distributions | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |------------------|:-----------:|:----------:|:---------:|------------------------| -|
    BERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    RoBERTa
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    ALBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    DistilBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    GPT2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    T5
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | -|
    ViT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | -|
    Swin
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | -|
    Wav2Vec2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | -|
    Stable Diffusion
    |
    ✅
    |
    ❌
    |
    ❌
    |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | +|
    BERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    RoBERTa
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    ALBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    DistilBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    GPT2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +|
    T5
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | +|
    ViT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +|
    Swin
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +|
    Wav2Vec2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | +|
    Stable Diffusion
    |
    ✅
    |
    ❌
    |
    ❌
    |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From 0fad94c81072e0827f91e296009e6ec2292797cb Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 23:33:38 +0100 Subject: [PATCH 25/28] Fix --- docs/source/index.mdx | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/docs/source/index.mdx b/docs/source/index.mdx index ea68a32794..dfabae0d4e 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -24,16 +24,16 @@ The table below shows which model architectures, tasks and device distributions | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |------------------|:-----------:|:----------:|:---------:|------------------------| -|
    BERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    RoBERTa
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    ALBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    DistilBERT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    GPT2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | -|
    T5
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | -|
    ViT
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | -|
    Swin
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | -|
    Wav2Vec2
    |
    ✅
    |
    ✅
    |
    ✅
    |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | -|
    Stable Diffusion
    |
    ✅
    |
    ❌
    |
    ❌
    |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | +| BERT | ✅ | ✅ | ✅ |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| RoBERTa | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| ALBERT | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| DistilBERT | ✅ | ✅ | ✅ |
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| GPT2 | ✅ | ✅ | ✅ |
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | +| T5 | ✅ | ✅ | ✅ |
  • [summarization](https://github.com/huggingface/optimum-habana/tree/main/examples/summarization)
  • [translation](https://github.com/huggingface/optimum-habana/tree/main/examples/translation)
    • | +| ViT | ✅ | ✅ | ✅ |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +| Swin | ✅ | ✅ | ✅ |
  • [image classification](https://github.com/huggingface/optimum-habana/tree/main/examples/image-classification)
    • | +| Wav2Vec2 | ✅ | ✅ | ✅ |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | +| Stable Diffusion | ✅ | ❌ | ❌ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From 6f54ed368fad98e29a274f340e1ab29bc19a9c16 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 23:40:20 +0100 Subject: [PATCH 26/28] Center tables --- README.md | 5 +++++ docs/source/index.mdx | 4 ++++ 2 files changed, 9 insertions(+) diff --git a/README.md b/README.md index 97a234d4cd..9bd28a1242 100644 --- a/README.md +++ b/README.md @@ -211,6 +211,9 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ ## Validated Models The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: + +
    + | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |--------------|:-----------:|:----------:|:---------:|------------------------| | BERT | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | @@ -224,6 +227,8 @@ The following model architectures, tasks and device distributions have been vali | Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | | Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | +
    + Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. If you find any issue while using those, please open an issue or a pull request. diff --git a/docs/source/index.mdx b/docs/source/index.mdx index dfabae0d4e..6a389d3641 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -22,6 +22,8 @@ limitations under the License. The table below shows which model architectures, tasks and device distributions are currently supported for 🤗 Optimum Habana: +
    + | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |------------------|:-----------:|:----------:|:---------:|------------------------| | BERT | ✅ | ✅ | ✅ |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | @@ -35,6 +37,8 @@ The table below shows which model architectures, tasks and device distributions | Wav2Vec2 | ✅ | ✅ | ✅ |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | | Stable Diffusion | ✅ | ❌ | ❌ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | +
    + Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From 86ecd321ac61c3e6684fb5192918006b398699b0 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 23:46:54 +0100 Subject: [PATCH 27/28] Fix --- README.md | 4 ++-- docs/source/index.mdx | 4 ++-- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 9bd28a1242..5865f6ea59 100644 --- a/README.md +++ b/README.md @@ -212,7 +212,7 @@ Check [the documentation of Optimum Habana](https://huggingface.co/docs/optimum/ The following model architectures, tasks and device distributions have been validated for 🤗 Optimum Habana: -
    +
    | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |--------------|:-----------:|:----------:|:---------:|------------------------| @@ -227,7 +227,7 @@ The following model architectures, tasks and device distributions have been vali | Wav2Vec2 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | | Stable Diffusion | :heavy_check_mark: | ✗ | ✗ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | -
    + Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. diff --git a/docs/source/index.mdx b/docs/source/index.mdx index 6a389d3641..9b887386f0 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -22,7 +22,7 @@ limitations under the License. The table below shows which model architectures, tasks and device distributions are currently supported for 🤗 Optimum Habana: -
    +
    | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |------------------|:-----------:|:----------:|:---------:|------------------------| @@ -37,7 +37,7 @@ The table below shows which model architectures, tasks and device distributions | Wav2Vec2 | ✅ | ✅ | ✅ |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | | Stable Diffusion | ✅ | ❌ | ❌ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | -
    + Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. From 7c8a18ebd97da9e29fb9c9d11bae501923f12227 Mon Sep 17 00:00:00 2001 From: regisss Date: Fri, 9 Dec 2022 23:57:54 +0100 Subject: [PATCH 28/28] Fix --- docs/source/index.mdx | 4 ---- 1 file changed, 4 deletions(-) diff --git a/docs/source/index.mdx b/docs/source/index.mdx index 9b887386f0..dfabae0d4e 100644 --- a/docs/source/index.mdx +++ b/docs/source/index.mdx @@ -22,8 +22,6 @@ limitations under the License. The table below shows which model architectures, tasks and device distributions are currently supported for 🤗 Optimum Habana: -
    - | Architecture | Single Card | Multi Card | DeepSpeed |
    Tasks
    | |------------------|:-----------:|:----------:|:---------:|------------------------| | BERT | ✅ | ✅ | ✅ |
  • [text classification](https://github.com/huggingface/optimum-habana/tree/main/examples/text-classification)
  • [question answering](https://github.com/huggingface/optimum-habana/tree/main/examples/question-answering)
  • [language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)
    • | @@ -37,8 +35,6 @@ The table below shows which model architectures, tasks and device distributions | Wav2Vec2 | ✅ | ✅ | ✅ |
  • [audio classification](https://github.com/huggingface/optimum-habana/tree/main/examples/audio-classification)
  • [speech recognition](https://github.com/huggingface/optimum-habana/tree/main/examples/speech-recognition)
    • | | Stable Diffusion | ✅ | ❌ | ❌ |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | -
    - Other models and tasks supported by the 🤗 Transformers library may also work. You can refer to the [Quickstart](./quickstart) for examples on using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana.