Skip to content

[Perf] Add SM90 skinny GEMM plans for dense Qwen3 and Llama-3.1 decode (TP=1) - #64979

Draft
Rockyeast wants to merge 2 commits into
vllm-project:mainfrom
Rockyeast:skinny-sm90-dense
Draft

Rockyeast wants to merge 2 commits into
vllm-project:mainfrom
Rockyeast:skinny-sm90-dense

Add SM90 skinny GEMM plans for the Qwen3-30B-A3B dense projections

03c141b
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Nov 1, 2026 in 0s

There is no internal Diff connected, this can be merged now