Skip to content

Commit

Permalink
Update index.mdx (#696)
Browse files Browse the repository at this point in the history
  • Loading branch information
Hao-tian-Zheng authored Nov 16, 2023
1 parent a730a63 commit 4e3723d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion website/blog/2023-07-14-Local-LLMs/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ Finally, launch the RESTful API server
python -m fastchat.serve.openai_api_server --host localhost --port 8000
```

Normally this will work. However, if you encounter error like [this](https://github.com/lm-sys/FastChat/issues/1641), commenting out all the lines containing `finish_reason` in `fastchat/protocol/api_protocal.py` and `fastchat/protocol/openai_api_protocol.py` will fix the problem. The modified code looks like:
Normally this will work. However, if you encounter error like [this](https://github.com/lm-sys/FastChat/issues/1641), commenting out all the lines containing `finish_reason` in `fastchat/protocol/api_protocol.py` and `fastchat/protocol/openai_api_protocol.py` will fix the problem. The modified code looks like:

```python
class CompletionResponseChoice(BaseModel):
Expand Down

0 comments on commit 4e3723d

Please sign in to comment.