[WIP] Add support for HuggingFace Chat Templates#1365

Closed

Tostino wants to merge 34 commits into

vllm-project:mainfrom

Commits on Oct 16, 2023

Add support for HF chat templates for OpenAI endpoint. Add support for a manually specified template file.
Tostino
committed
Add support for conversation-template argument which takes the path to a json template. Added to quickstart.rst and example json file in the examples folder.
Tostino
committed
Fix formatting
Tostino
committed
Fix formatting as yapf wants it to be...
Tostino
committed
Additional formatting fixes.
Tostino
committed
Add support for HF chat templates for OpenAI endpoint. Add support for a manually specified template file.
Tostino
committed
Merge remote-tracking branch 'origin/main'
Tostino
committed
Fix readme for incorrect reference.
Tostino
committed
Additional formatting changes...unsure how some of these got messed up, must have been ide formatting things and I didn't notice.
Tostino
committed
More failing formatting because some code was more indented than original
Tostino
committed
More failing formatting...
Tostino
committed
More failing formatting...I am getting sick of this.
Tostino
committed
More failing formatting...I am getting extremely sick of this.
Tostino
committed

Commits on Oct 19, 2023

Merge branch 'vllm-project:main' into main
Tostino
authored

Commits on Oct 21, 2023

Merge branch 'vllm-project:main' into main
Tostino
authored

Commits on Oct 22, 2023

Support SqueezeLLM (#1326)

authored

Commits on Oct 25, 2023

Add support for conversation-template argument which takes the path to a json template. Added to quickstart.rst and example json file in the examples folder.

Tostino
authored and
lucasstinson
committed
Fix formatting

Tostino
authored and
lucasstinson
committed
Fix formatting as yapf wants it to be...

Tostino
authored and
lucasstinson
committed
Additional formatting fixes.

Tostino
authored and
lucasstinson
committed
Add support for HF chat templates for OpenAI endpoint. Add support for a manually specified template file.

Tostino
authored and
lucasstinson
committed
Fix readme for incorrect reference.

Tostino
authored and
lucasstinson
committed
Additional formatting changes...unsure how some of these got messed up, must have been ide formatting things and I didn't notice.

Tostino
authored and
lucasstinson
committed
More failing formatting because some code was more indented than original

Tostino
authored and
lucasstinson
committed
More failing formatting...

Tostino
authored and
lucasstinson
committed
More failing formatting...I am getting sick of this.

Tostino
authored and
lucasstinson
committed
More failing formatting...I am getting extremely sick of this.

Tostino
authored and
lucasstinson
committed
Merge remote-tracking branch 'origin/main'
lucasstinson
committed