Skip to content

Add option in OpenAI API to disable special tokens when tokenizing#2263

Closed
liuyanyi wants to merge 1 commit intovllm-project:mainfrom
liuyanyi:main
Closed

Add option in OpenAI API to disable special tokens when tokenizing#2263
liuyanyi wants to merge 1 commit intovllm-project:mainfrom
liuyanyi:main

Commits

Commits on Dec 26, 2023