Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/source/en/model_doc/flan-ul2.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ One can refer to [T5's documentation page](t5) for all tips, code examples and n
The original checkpoints can be found [here](https://github.com/google-research/t5x/blob/main/docs/models.md#flan-ul2-checkpoints).


## Running on low ressources devices
## Running on low resource devices

The model is pretty heavy (~40GB in half precision) so if you just want to run the model, make sure you load your model in 8bit, and use `device_map="auto"` to make sure you don't have any OOM issue!

Expand All @@ -49,4 +49,4 @@ The model is pretty heavy (~40GB in half precision) so if you just want to run t

## Inference

The inference protocol is exaclty the same as any `T5` model, please have a look at the [T5's documentation page](t5) for more details.
The inference protocol is exaclty the same as any `T5` model, please have a look at the [T5's documentation page](t5) for more details.