[Bugfix] Keep all tensors to be on the same device#31958

wjunLu wants to merge 1 commit intovllm-project:mainvllm-project/vllm:mainfrom

wjunLu:bugfixwjunLu/vllm:bugfixCopy head branch name to clipboard