Skip to content

[Bugfix] Zero-init MLA attention output buffers to prevent NaN from CUDA graph padding - #37442

Merged
tlrmchlsmth merged 4 commits into
vllm-project:mainfrom
elvircrn:zero-init-attn-output-pr
Mar 19, 2026
Merged

[Bugfix] Zero-init MLA attention output buffers to prevent NaN from CUDA graph padding#37442
tlrmchlsmth merged 4 commits into
vllm-project:mainfrom
elvircrn:zero-init-attn-output-pr

Zero after kernel for q_len > 1

ac29832
Select commit
Loading
Failed to load commit list.