[diffusion] Enable breakable CUDA graph (BCG) for diffusion DiTs - #27436

Merged

BBuf merged 86 commits into

sgl-project:mainfrom

BBuf:diffusion/breakable-cuda-graph

Jul 8, 2026

Commits on Jul 3, 2026

[diffusion] Enable breakable CUDA graph (BCG) for diffusion DiTs

authored and
BBuf
committed
3954bd7
BCG prompt-invariant capture + cosmos3 / SANA / LTX-2

authored and
BBuf
committed
15b836e
[diffusion] BCG: support Helios + Wan, harden runner for CPU inputs

authored and
BBuf
committed
b7a8c16
[diffusion] BCG: scope wiring to SANA / Cosmos3 / Wan2.x

authored and
BBuf
committed
4cef688
[diffusion] Make Z-Image BCG capture-safe
BBuf
committed
9184375
[diffusion] Route DMD denoising through BCG runner
BBuf
committed
2d5a267
[diffusion] Make video rotary inputs BCG capture-safe
BBuf
committed
9745aa8
[diffusion] Make GLM-Image BCG capture-safe
BBuf
committed
edd2bf2
[diffusion] Make LTX-2 BCG capture-safe
BBuf
committed
0aeb321
[diffusion] Make Hunyuan3D shape BCG capture-safe
BBuf
committed
92aa9cd
[diffusion] Make LTX-2.3 warmup BCG-safe
BBuf
committed
dbf8bbf
[diffusion] Make LTX-2.3 perturbation masks BCG-safe
BBuf
committed
2317c23
[diffusion] Make Helios BCG capture-safe
BBuf
committed
abbbe6f
[diffusion] Make MOVA dual-tower BCG-safe
BBuf
committed
b3ba566
[diffusion] Skip edit-model warmup BCG capture
BBuf
committed
9159a38
Fix diffusion BCG prompt bucketing lint
BBuf
committed
bb82c40
Bucket masked diffusion prompts for BCG
BBuf
committed
b9ce17e
Fix Z-Image BCG prompt padding
BBuf
committed
93b460b
Fix GLM Image BCG prompt reuse
BBuf
committed
86ceb95
Fix edit-model BCG warmup capture
BBuf
committed
aa71ebf
Fix Hunyuan3D BCG warmup capture
BBuf
committed
6383c81
Disable HunyuanVideo BCG replay for prompt correctness
BBuf
committed
d705077
Default missing diffusion flags to disabled in tests
BBuf
committed
9c032e9
Fix Helios BCG warmup capture
BBuf
committed
6def28b
Fix LTX2.3 BCG warmup capture
BBuf
committed
2be15b7
Fix diffusion BCG lint issues
BBuf
committed
b632a71
Add diffusion BCG service validation helper
BBuf
committed
88ab259
Fix Qwen diffusion BCG varlen replay
BBuf
committed
1315427
Use fused Qwen modulation ops under diffusion BCG
BBuf
committed
1b1261e
Use fused Qwen select modulation under diffusion BCG
BBuf
committed
7fa0e35
[diffusion] Add explicit BCG resolution + text-bucket server args

authored and
BBuf
committed
f9594bd
[diffusion] Extract BCG prompt-padding helpers into bcg_utils + model modules

authored and
BBuf
committed
a1fb29f
[diffusion] Add BaseBreakableCudaGraphRunner with capture/replay API

authored and
BBuf
committed
ec2da16
[diffusion] Capture all BCG graphs at warmup so serving never recaptures

authored and
BBuf
committed
47c2372
[diffusion] Force server-based warmup under BCG so capture happens at startup

authored and
BBuf
committed
12b6bce
[diffusion] Harden BCG re-capture campaign driver (free-port probe + retry)

authored and
BBuf
committed
a9ec07a
[diffusion] BCG runner: capture-on-first-use + restore visible capture log

authored and
BBuf
committed
68a6f8d
[diffusion] Remove temporary BCG PR-validation helper scripts

authored and
BBuf
committed
6aab6b9
[diffusion] Fix unreachable --bcg-text-buckets validation

authored and
BBuf
committed
e166e99
[diffusion] Allow BCG captures beyond reserved memory threshold
BBuf
committed
934627e
Fix Cohere2Moe config import
BBuf
committed
44769e1
Fix Cohere2Moe config startup compatibility
BBuf
committed
1446f2d
Restrict diffusion BCG support
BBuf
committed
fdc2510
Limit diffusion BCG to Qwen Image models
BBuf
committed
6321189
Scope diffusion BCG to Qwen Image
BBuf
committed
7905812
Drop server args BCG unit changes
BBuf
committed
67110cb
Document diffusion replay token use
BBuf
committed
c021e25
Clarify diffusion BCG padding utilities docstring
BBuf
committed
e3d4e57
Add Z-Image diffusion BCG support
BBuf
committed
6882e67
Enable BCG for GLM Image and FLUX2 Klein
BBuf
committed
37beef8
Remove FLUX2 Klein from diffusion BCG allowlist
BBuf
committed
789f238
Fix diffusion BCG lint formatting
BBuf
committed
41d5e39
Disable GLM Image diffusion BCG support
BBuf
committed
63cc964
Restore GLM Image BCG support
BBuf
committed
26d1302
Refactor diffusion BCG helpers
BBuf
committed
6c531c7
Add Ideogram diffusion BCG support
BBuf
committed
0ec34f2
Revert "Add Ideogram diffusion BCG support"
BBuf
committed
5acfcfe
Revert "Revert "Add Ideogram diffusion BCG support""
BBuf
committed
7bb08a6
Fix diffusion BCG lint formatting
BBuf
committed
83eb826
Merge remote-tracking branch 'origin/main' into diffusion/breakable-cuda-graph
BBuf
committed
c2c07cb

Commits on Jul 4, 2026

[diffusion] Fix BCG-vs-main integration breakage after merge

BBuf
and
claude
committed
33ea232
Merge remote-tracking branch 'origin/main' into HEAD
BBuf
committed
1549091
Fix BCG failure hint re-export after main merge
BBuf
committed
01581fd
Fix BCG backend graph construction after API split
BBuf
committed
361b779
Merge remote-tracking branch 'origin/main' into HEAD
BBuf
committed
f6fa91c
Stabilize DSV4 HiCache CI memory margin
BBuf
committed
2873e2a
Re-export breakable CUDA graph copy helper
BBuf
committed
7e6c099
Merge remote-tracking branch 'origin/main' into HEAD
BBuf
committed
d909c7d
Increase DeepSeek V3 CP test memory fraction
BBuf
committed
8fc27c4
Fix Z-Image eager path for BCG prompt padding
BBuf
committed
aa921fc
Merge remote-tracking branch 'origin/main' into HEAD
BBuf
committed
a6306ee
Merge remote-tracking branch 'origin/main' into HEAD
BBuf
committed
f797d06
Merge remote-tracking branch 'origin/main' into HEAD
BBuf
committed
2e15d7a
Fix MOVA SP merge lint
BBuf
committed
12caf89

Commits on Jul 5, 2026

Fix diffusion BCG CI failures
BBuf
committed
7b2a549
Relax Qwen NPU consistency threshold
BBuf
committed
98586b7
Relax NPU W4A4 throughput guard
BBuf
committed
7e94827
Merge main and fix legacy accessor ratchet
BBuf
committed
3d312f5
Update ZImage 2-GPU denoise baseline
BBuf
committed
47e274e
Retry transient diffusion GT download misses
BBuf
committed
8b3fdde
Relax NPU W4A4 throughput guard again
BBuf
committed
4ff2c07
Stabilize AMD diffusion update-weights CI
BBuf
committed
dacb13c
Merge remote-tracking branch 'origin/main' into diffusion/breakable-cuda-graph
BBuf
committed
19d8735
Revert unrelated CI and non-diffusion test tweaks
BBuf
committed
bad8cd8

Commits on Jul 8, 2026

Merge origin/main into diffusion/breakable-cuda-graph
BBuf
committed
b2a57ab
Use Z-Image caption mask for BCG padding
BBuf
committed
28c1c28