Skip to content

Commit

Permalink
fixed a format issue for docusaurus publication (#871)
Browse files Browse the repository at this point in the history
### What problem does this PR solve?

_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._

### Type of change

- [x] Documentation Update
  • Loading branch information
writinwaters authored May 22, 2024
1 parent b62a208 commit d5b8d8e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/guides/deploy_local_llm.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ $ xinference-local --host 0.0.0.0 --port 9997
### Launch Xinference

Decide which LLM you want to deploy ([here's a list for supported LLM](https://inference.readthedocs.io/en/latest/models/builtin/)), say, **mistral**.
Execute the following command to launch the model, remember to replace ${quantization} with your chosen quantization method from the options listed above:
Execute the following command to launch the model, remember to replace `${quantization}` with your chosen quantization method from the options listed above:
```bash
$ xinference launch -u mistral --model-name mistral-v0.1 --size-in-billions 7 --model-format pytorch --quantization ${quantization}
```
Expand Down

0 comments on commit d5b8d8e

Please sign in to comment.