Skip to content

[Core] Don't count preempted tokens in prefix cache hit rate - #25787

Merged
zhuohan123 merged 2 commits into
mainfrom
zhuohan/fix-prefix-caching-stat
Sep 27, 2025
Merged

[Core] Don't count preempted tokens in prefix cache hit rate#25787
zhuohan123 merged 2 commits into
mainfrom
zhuohan/fix-prefix-caching-stat

Merge branch 'main' into zhuohan/fix-prefix-caching-stat

a2a8089
Select commit
Loading
Failed to load commit list.