Skip to content

[Perf][DSv4.1] Split fused_wqa_wkv by token across TP ranks on SM90 - #58872

Merged
zyongye merged 3 commits into
vllm-project:mainfrom
ShuoleiWang:perf/dsv41-shard-attn-input-proj
Oct 16, 2026
Merged

[Perf][DSv4.1] Split fused_wqa_wkv by token across TP ranks on SM90#58872
zyongye merged 3 commits into
vllm-project:mainfrom
ShuoleiWang:perf/dsv41-shard-attn-input-proj

Commits

  1. Commits on Sep 30, 2026

  2. Commits on Oct 13, 2026

  3. Commits on Oct 15, 2026