Skip to content

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens#41800

Merged
DarkLight1337 merged 3 commits into
vllm-project:mainfrom
tenstorrent:fix-truncate-max-tokens
May 6, 2026
Merged

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens#41800
DarkLight1337 merged 3 commits into
vllm-project:mainfrom
tenstorrent:fix-truncate-max-tokens

Commits

Commits on May 6, 2026