Skip to content

hicache: restore per-tier (L1/L2/L3) KV cache hit metrics - #31883

Open
TianDi101 wants to merge 2 commits into
sgl-project:mainfrom
TianDi101:feat/hicache-per-tier-hit-metrics
Open

hicache: restore per-tier (L1/L2/L3) KV cache hit metrics#31883
TianDi101 wants to merge 2 commits into
sgl-project:mainfrom
TianDi101:feat/hicache-per-tier-hit-metrics

monitoring: add per-tier Cache Hit Rate + Cached Tokens Rate panels

620016c
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
label
succeeded Jul 21, 2026 in 6s