Skip to content

[None][fix] Fix DSACacheManager and RocketCacheManager KV cache estimation ignoring num_layers for draft models - #12571

Merged
longlee0622 merged 4 commits into
NVIDIA:mainfrom
lancelly:test_kv_cache
Mar 31, 2026
Merged

[None][fix] Fix DSACacheManager and RocketCacheManager KV cache estimation ignoring num_layers for draft models#12571
longlee0622 merged 4 commits into
NVIDIA:mainfrom
lancelly:test_kv_cache

Merge branch 'main' into test_kv_cache

ca52e3e
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Mar 30, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO