[None][feat] kv cache manager v1 use fabric memory to enable mnnvl transfer for kv cache transfer in disaggregated serving - #12490

[None][feat] kv cache manager v1 use fabric memory to enable mnnvl transfer for kv cache transfer in disaggregated serving#12490

chuangz0 merged 9 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

chuangz0:kv_cache_manager_pool_use_fabric_memorychuangz0/TensorRT-LLM:kv_cache_manager_pool_use_fabric_memoryCopy head branch name to clipboard