[NIXL] Add CacheLayout meta-tensor abstraction for descriptor generation#44362

ZhanqiuHu wants to merge 13 commits into

vllm-project:mainvllm-project/vllm:mainfrom

ZhanqiuHu:zhanqiu/cache-layout-on-tp-mappingZhanqiuHu/vllm:zhanqiu/cache-layout-on-tp-mappingCopy head branch name to clipboard