Skip to content

[Perf] Skip detokenization in online beam search - #46422

Merged
vllm-bot merged 3 commits into
vllm-project:mainfrom
GuyStone:beam-search-skip-detokenize
Jun 23, 2026
Merged

vllm-bot merged 3 commits into
vllm-project:mainfrom
GuyStone:beam-search-skip-detokenize

Update vllm/entrypoints/generate/beam_search/online.py

d78bea4
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Jun 23, 2026 in 0s

There is no internal Diff connected, this can be merged now