[Performance][MiniCPM-o] Cache native tokenizer in duplex adapter to reduce event loop blocking (#6719) - #7524

[Performance][MiniCPM-o] Cache native tokenizer in duplex adapter to reduce event loop blocking (#6719)#7524

BeatSeat wants to merge 2 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

BeatSeat:perf/minicpmo45-cache-native-tokenizer-6719BeatSeat/vllm-omni:perf/minicpmo45-cache-native-tokenizer-6719Copy head branch name to clipboard