[Frontend] Speed up online server preprocess by using sync tokenizer.#27407

noooop wants to merge 7 commits into

vllm-project:mainvllm-project/vllm:mainfrom

noooop:server_overheadnoooop/vllm:server_overheadCopy head branch name to clipboard