Skip to content

Commit

Permalink
Add requirements to readme
Browse files Browse the repository at this point in the history
  • Loading branch information
prusnak committed Mar 18, 2023
1 parent d3f202d commit 26ff76d
Showing 1 changed file with 8 additions and 1 deletion.
9 changes: 8 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,14 @@ python3 convert-pth-to-ggml.py models/7B/ 1

When running the larger models, make sure you have enough disk space to store all the intermediate files.

TODO: add model disk/mem requirements
### Requirements

| model | original download size | quantized size (4-bit) |
|-------|------------------------|------------------------|
| 7B | 13 GB | 3.9 GB |
| 15B | 24 GB | 7.8 GB |
| 30B | 60 GB | 19.5 GB |
| 65B | 120 GB | 38.5 GB |

### Interactive mode

Expand Down

0 comments on commit 26ff76d

Please sign in to comment.