Skip to content

Commit

Permalink
Merge pull request #214 from yy307/patch-1
Browse files Browse the repository at this point in the history
Update QAnything_Startup_Usage_README.md
change git clone to git lfs clone when downloading LLM model from huggingface
  • Loading branch information
successren authored Apr 8, 2024
2 parents 64a08a9 + bed604d commit 9db7d15
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/QAnything_Startup_Usage_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ bash ./run.sh -c local -i 0 -b hf -m Qwen-7B-QAnything -t qwen-7b-qanything
```bash
## Step 1. Download the public LLM model (e.g., MiniChat-2-3B) and save to "/path/to/QAnything/assets/custom_models"
cd /path/to/QAnything/assets/custom_models
git clone https://huggingface.co/GeneZC/MiniChat-2-3B
git lfs clone https://huggingface.co/GeneZC/MiniChat-2-3B

## Step 2. Execute the service startup command. Here we use "-b hf" to specify the Huggingface transformers backend.
## Here we use "-b hf" to specify the transformers backend that will load model in 8 bits but do bf16 inference as default for saving VRAM.
Expand Down

0 comments on commit 9db7d15

Please sign in to comment.