Skip to content

[Bugfix] release KV blocks for skipped P-ranks to prevent invalid KV errors and timeouts when P_tp > D_tp and MLA#40449

Merged
simon-mo merged 4 commits into
vllm-project:mainfrom
yangrz7:main-fix
Apr 28, 2026
Merged

[Bugfix] release KV blocks for skipped P-ranks to prevent invalid KV errors and timeouts when P_tp > D_tp and MLA#40449
simon-mo merged 4 commits into
vllm-project:mainfrom
yangrz7:main-fix

Commits

Commits on Apr 21, 2026

Commits on Apr 27, 2026

Commits on Apr 28, 2026