Skip to content

[Bugfix] add truncate_prompt_tokens to work offline, directly from LLM class.#4598

Closed
yecohn wants to merge 3 commits intovllm-project:mainfrom
yecohn:truncate_usage_pr
Closed

[Bugfix] add truncate_prompt_tokens to work offline, directly from LLM class.#4598
yecohn wants to merge 3 commits intovllm-project:mainfrom
yecohn:truncate_usage_pr

Commits

Commits on May 4, 2024