[Hardware] Replace memory related torch.cuda APIs #37031

hmellor merged 7 commits intovllm-project:mainvllm-project/vllm:mainfrom

jikunshang:kunshang/acc_memjikunshang/vllm:kunshang/acc_memCopy head branch name to clipboard