Skip to content

[TRTLLM-13308][feat] Make the KVCacheManagerV2 KV pool rebalance safe under TP, CP, PP and attention DP - #17391

Merged
thorjohnsen merged 9 commits into
NVIDIA:mainfrom
thorjohnsen:thor/kvcmv2-tp-rebalance-agreement
Aug 17, 2026
Merged

[TRTLLM-13308][feat] Make the KVCacheManagerV2 KV pool rebalance safe under TP, CP, PP and attention DP#17391
thorjohnsen merged 9 commits into
NVIDIA:mainfrom
thorjohnsen:thor/kvcmv2-tp-rebalance-agreement