Repository navigation

[Core] Bounded-memory streaming sessions: retention, in-place KV eviction, consolidation - #53876

Draft

nvbfalk wants to merge 3 commits into

vllm-project:mainfrom

nvbfalk:pr3-bounded-sessions

Draft

[Core] Bounded-memory streaming sessions: retention, in-place KV eviction, consolidation#53876
nvbfalk wants to merge 3 commits into
vllm-project:mainfrom
nvbfalk:pr3-bounded-sessions

Commits on Aug 25, 2026
- [Core] KV cache: block-range eviction for live requests
  
  nvbfalk
  and
  claude
  committed
  af40d04
- [Bugfix] Harden streaming-input session lifecycle
  
  nvbfalk
  and
  claude
  committed
  a489f9e
- [Core][Draft] Bounded-memory streaming sessions: retention, in-place KV eviction, consolidation
  
  nvbfalk
  and
  claude
  committed
  89bfabd