[Bugfix] Share MLA decode output buffer across layers to fix OOM#37799
Open
elvircrn wants to merge 1 commit intovllm-project:mainfrom
Open
[Bugfix] Share MLA decode output buffer across layers to fix OOM#37799elvircrn wants to merge 1 commit intovllm-project:mainfrom
elvircrn wants to merge 1 commit intovllm-project:mainfrom
