[ROCm][Bugfix] Add +256 col guard to preshuffle logits buffer (DSv3.2)#41856
Open
frida-andersson wants to merge 1 commit intovllm-project:mainfrom
Open
[ROCm][Bugfix] Add +256 col guard to preshuffle logits buffer (DSv3.2)#41856frida-andersson wants to merge 1 commit intovllm-project:mainfrom
frida-andersson wants to merge 1 commit intovllm-project:mainfrom