Skip to content

[Core] Don't count preempted tokens in prefix cache hit rate#25787

Merged
zhuohan123 merged 2 commits intomainfrom
zhuohan/fix-prefix-caching-stat
Sep 27, 2025
Merged

[Core] Don't count preempted tokens in prefix cache hit rate#25787
zhuohan123 merged 2 commits intomainfrom
zhuohan/fix-prefix-caching-stat

Commits

Commits on Sep 26, 2025