[#12595][feat] Emit initial KV cache stats at startup for external metric scrapers - #12596

Merged

Tabrizian merged 5 commits into

NVIDIA:mainfrom

BenjaminBraunDev:initial-stats-sweep

Jul 22, 2026

Commits on Jul 20, 2026

Emit initial KV cache stats at startup for external metric scrapers

BenjaminBraunDev
authored and
Tabrizian
committed
9e31d7f
Address review nits: return type annotation and bounded polling

BenjaminBraunDev
authored and
Tabrizian
committed
6b3ed06
Update prometheus test to check kv_cache_utilization instead of cache_config_info

BenjaminBraunDev
authored and
Tabrizian
committed
350eeb3
update test to not reference metrics by index and count assertions

BenjaminBraunDev
authored and
Tabrizian
committed
27f8340
Fix pre-commit yapf failures in test_llm_context_only_timed_out

BenjaminBraunDev
authored and
Tabrizian
committed
31985ea