[Fix] Use a correct device when creating OptionalCUDAGuard#2583
Merged
LiuXiaoxuanPKU merged 1 commit intovllm-project:mainfrom Jan 26, 2024
Merged
[Fix] Use a correct device when creating OptionalCUDAGuard#2583LiuXiaoxuanPKU merged 1 commit intovllm-project:mainfrom
LiuXiaoxuanPKU merged 1 commit intovllm-project:mainfrom
