Repository navigation

[None][feat] KDA verify: optional per-token states in the V2 hybrid cache manager - #19817

Closed

vsabavat wants to merge 8 commits into

NVIDIA:mainfrom

vsabavat:k3-up/u2-kda-verify-state

Closed

[None][feat] KDA verify: optional per-token states in the V2 hybrid cache manager#19817
vsabavat wants to merge 8 commits into
NVIDIA:mainfrom
vsabavat:k3-up/u2-kda-verify-state

Commits on Oct 2, 2026
- [None][feat] KDA verify: optional per-token states in the V2 hybrid cache manager
  vsabavat
  committed
  f6cb23b
- [None][fix] KV cache manager V2: keep the SSM pool at its live floor with per-token KDA states
  vsabavat
  committed
  f3cf23f
Commits on Oct 3, 2026
- [None][fix] KV cache manager V2: take the per-token KDA states out of the GPU quota at the SSM live floor
  vsabavat
  committed
  e30477f
Commits on Oct 4, 2026
- [None][fix] KV cache manager V2: count the live-floor KDA token-state slots as the runtime does
  vsabavat
  committed
  a9938c2
- [None][fix] KV cache manager V2: refuse per-token KDA states off the SSM live floor
  vsabavat
  committed
  54b87a2
Commits on Oct 7, 2026