Skip to content

[None][fix] Fix DSACacheManager and RocketCacheManager KV cache estimation ignoring num_layers for draft models - #12683

Merged
longlee0622 merged 1 commit into
NVIDIA:feat/bench_yfrom
lancelly:cp-481e946-feat-bench_y
Apr 2, 2026
Merged

[None][fix] Fix DSACacheManager and RocketCacheManager KV cache estimation ignoring num_layers for draft models#12683
longlee0622 merged 1 commit into
NVIDIA:feat/bench_yfrom
lancelly:cp-481e946-feat-bench_y

[None][fix] Fix DSACacheManager and RocketCacheManager KV cache estim…

9b45e47
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Apr 2, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO