[Core] Size the KV cache from this process's own device memory, not the device-wide delta - #55828

[Core] Size the KV cache from this process's own device memory, not the device-wide delta#55828

twu3202 wants to merge 2 commits into

vllm-project:mainvllm-project/vllm:mainfrom

twu3202:profiling-process-memorytwu3202/vllm:profiling-process-memoryCopy head branch name to clipboard