Skip to content

[https://nvbugs/5537996][fix] Let KV cache manager block initialization be aware whether it is doing a dry run or not#9093

Merged
eopXD merged 2 commits into
NVIDIA:mainfrom
eopXD:fix-max_tokens-settings
Nov 25, 2025
Merged

[https://nvbugs/5537996][fix] Let KV cache manager block initialization be aware whether it is doing a dry run or not#9093
eopXD merged 2 commits into
NVIDIA:mainfrom
eopXD:fix-max_tokens-settings

Fix primary/sceondary block number calculation too

a5ca0d3
Select commit
Loading
Failed to load commit list.