Skip to content

[Bugfix] Fix RuntimeError: Already borrowed that degrades VLM serving throughput under concurrent load.#36557

Merged
vllm-bot merged 3 commits into
vllm-project:mainfrom
hallerite:fix/tokenizer-thread-safety
Mar 10, 2026
Merged

[Bugfix] Fix RuntimeError: Already borrowed that degrades VLM serving throughput under concurrent load.#36557
vllm-bot merged 3 commits into
vllm-project:mainfrom
hallerite:fix/tokenizer-thread-safety

Merge branch 'main' into fix/tokenizer-thread-safety

0466330
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Mar 10, 2026 in 0s

There is no internal Diff connected, this can be merged now