[TRTLLM-7731][feat] Avoid over-allocation of KV cache for transmission in disagg with CP#8145

brb-nv merged 4 commits intoNVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

brb-nv:user/brb/avoid-overalloc-in-cp-disaggbrb-nv/TensorRT-LLM:user/brb/avoid-overalloc-in-cp-disaggCopy head branch name to clipboard