[ROCm][Bugfix] Add +256 col guard to preshuffle logits buffer (DSv3.2)#41810
Closed
frida-andersson wants to merge 1 commit intovllm-project:mainfrom
Closed
[ROCm][Bugfix] Add +256 col guard to preshuffle logits buffer (DSv3.2)#41810frida-andersson wants to merge 1 commit intovllm-project:mainfrom
frida-andersson wants to merge 1 commit intovllm-project:mainfrom