Skip to content

[Frontend] Speed up online server preprocess by using sync tokenizer.#27407

Closed
noooop wants to merge 7 commits intovllm-project:mainfrom
noooop:server_overhead
Closed

[Frontend] Speed up online server preprocess by using sync tokenizer.#27407
noooop wants to merge 7 commits intovllm-project:mainfrom
noooop:server_overhead

Commits

Commits on Oct 29, 2025

Commits on Nov 17, 2025