[Bugfix] add truncate_prompt_tokens to work offline, directly from LLM class.#4598
Closed
yecohn wants to merge 3 commits intovllm-project:mainfrom
Closed
[Bugfix] add truncate_prompt_tokens to work offline, directly from LLM class.#4598yecohn wants to merge 3 commits intovllm-project:mainfrom
yecohn wants to merge 3 commits intovllm-project:mainfrom