Skip to content

Log KV cache GiB usage and warn when max_num_seqs exceeds capacity#38408

Open
ashishkamra wants to merge 1 commit intovllm-project:mainfrom
ashishkamra:log-kv-cache-memory-gib
Open

Log KV cache GiB usage and warn when max_num_seqs exceeds capacity#38408
ashishkamra wants to merge 1 commit intovllm-project:mainfrom
ashishkamra:log-kv-cache-memory-gib

Commits

Commits on Mar 29, 2026