Skip to content

[Perf] diffusion: Project Wan's cross-attention text K/V once per denoising loop #46246

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
mickqian wants to merge 17 commits into from
Closed

[Perf] diffusion: Project Wan's cross-attention text K/V once per denoising loop #46246

Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
75cc4e7
[Perf] diffusion: Fuse Wan's q/k RMSNorm with its interleaved RoPE
mickqian Oct 23, 2026
8d407eb
[Perf] diffusion: Project Wan's q/k/v with one GEMM over a shared weight
mickqian Oct 23, 2026
0fa713b
[Perf] diffusion: Add each Wan block's FFN residual in the next block…
mickqian Oct 23, 2026
d3400ef
[Perf] diffusion: Project Wan's cross-attention text K/V once per prompt
mickqian Oct 24, 2026
3db3519
[Fix] diffusion: Let Wan's fused q/k/v weight go when its layers move
mickqian Oct 24, 2026
60410ca
Merge branch 'mick/wan-fused-qkv-gemm' into mick/wan-ffn-residual-chain
mickqian Oct 24, 2026
2a92c89
Merge branch 'mick/wan-ffn-residual-chain' into mick/wan-text-kv-once…
mickqian Oct 24, 2026
e1cc66a
[Fix] diffusion: Keep Wan's text K/V for one denoising loop of one re…
mickqian Oct 24, 2026
2e93936
[Test] diffusion: Move the Wan fused q/k/v test into test_model_fast_…
mickqian Oct 24, 2026
61cc032
Merge branch 'mick/wan-fused-qkv-gemm' into mick/wan-ffn-residual-chain
mickqian Oct 24, 2026
d4e8bc8
[Test] diffusion: Move the Wan FFN residual chain test into test_mode…
mickqian Oct 24, 2026
34d3aad
Merge branch 'mick/wan-ffn-residual-chain' into mick/wan-text-kv-once…
mickqian Oct 24, 2026
72938c9
[Test] diffusion: Move the Wan text K/V tests into test_model_fast_pa…
mickqian Oct 24, 2026
53d79dc
Merge updated parent and preserve Wan optimizations
mickqian Oct 24, 2026
268d45e
Merge updated parent and preserve Wan optimizations
mickqian Oct 24, 2026
d37fbba
Merge updated parent and preserve Wan optimizations
mickqian Oct 24, 2026
93f321a
Merge main to resolve Wan optimization conflicts
mickqian Oct 27, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view

These merge commits were added into this branch cleanly.

There are no new changes to show.