[TRTLLM-13308][feat] Make the KVCacheManagerV2 KV pool rebalance safe under TP, CP, PP and attention DP - #17391

Merged

thorjohnsen merged 9 commits into

NVIDIA:mainfrom

thorjohnsen:thor/kvcmv2-tp-rebalance-agreement

Aug 17, 2026

Commits on Aug 12, 2026

[None][fix] Agree the KVCacheManagerV2 rebalance trigger across TP ranks
thorjohnsen
committed
9236b8f
[None][fix] Extend the rebalance trigger agreement to context parallelism
thorjohnsen
committed
f688ad7
[None][fix] Address review on the rebalance trigger agreement
thorjohnsen
committed
29417dc
[None][fix] Keep the CP broadcast under attention DP
thorjohnsen
committed
1f1cb52
[None][feat] Extend the KVCacheManagerV2 rebalance to pipeline parallelism
thorjohnsen
committed
ef96782
[None][test] Unit-test the pipeline-parallel rebalance drain wiring
thorjohnsen
committed
c21efaa

Commits on Aug 13, 2026

[None][fix] Agree the rebalance trigger across attention-DP ranks
thorjohnsen
committed
70dd51f

Commits on Aug 14, 2026