[BI] Close the cudagraph paths that pick a graph per step, and warn about the one that stays - #25

Open

aoshen02 wants to merge 23 commits into

bi/basefrom

bi/cudagraph-mode

Commits on Aug 18, 2026

[Bugfix][BI] Keep piecewise cudagraphs out of batch-invariant runs

authored and
aoshen02
committed
2335717
[BI] Warn when a decode step can escape the cudagraph capture set

aoshen02
and
claude
committed
868ff0a
[BI] Close the piecewise fallbacks the FULL pin does not cover

aoshen02
and
claude
committed
cda715f
[BI] Refuse rather than override the other full-cudagraph blockers

aoshen02
and
claude
committed
4d40e80
[BI] Check for unsupported FULL before the pin, not inside it

aoshen02
and
claude
committed
bfccade
[BI] Sample the capture-size choice before any model hook can fill it in

aoshen02
and
claude
committed
2915337
[BI] Describe the criterion the warning actually uses

aoshen02
and
claude
committed
9526083
[BI] Keep the capture-size answer across config rebuilds

aoshen02
and
claude
committed
f7bc6fb
[BI] Route dynamic speculative decoding through the same refusal

aoshen02
and
claude
committed
a75f3d6
[BI] Close the last three full-cudagraph gaps

aoshen02
and
claude
committed
906f851
[BI] Refuse the multimodal encoder's own cudagraph dispatcher

aoshen02
and
claude
committed
32680bf
[BI] Close the remaining independent cudagraph dispatchers

aoshen02
and
claude
committed
f427d10
[BI] Check the mode-independent dispatchers independently of the mode

aoshen02
and
claude
committed
3839c66
[BI] Disable encoder cudagraphs where the capability is known

aoshen02
and
claude
committed
4650c31
[BI] Decide the encoder dispatcher after the capability it depends on

aoshen02
and
claude
committed
052e8c4
[BI][DSv4] Run test_batch_invariant_dispatchers.py in CI

aoshen02
and
claude
committed
1fd18fd
[BI][DSv4] Run the dispatcher regressions when the code they cover changes

aoshen02
and
claude
committed
57ef7e9
[BI] State what the piecewise pin buys, now that it is measurable

aoshen02
and
claude
committed
f20ae9d
[BI] Stop pinning cudagraph_mode, and warn instead

aoshen02
and
claude
committed
cc952f0
[BI] Drop the encoder and Gemma4 dispatcher changes

aoshen02
and
claude
committed
b518bcc

Commits on Aug 19, 2026

[BI] Make the config checks exact about what they cover

aoshen02
and
claude
committed
8c31527
[BI] Keep the @config decorator attached to VllmConfig

aoshen02
and
claude
committed
1079919
[BI] Give the microbatching tests a backend microbatching accepts

aoshen02
and
claude
committed
8ee0cda

Navigation Menu

[BI] Close the cudagraph paths that pick a graph per step, and warn about the one that stays - #25

[BI] Close the cudagraph paths that pick a graph per step, and warn about the one that stays#25
aoshen02 wants to merge 23 commits into
bi/basefrom
bi/cudagraph-mode

Commits on Aug 18, 2026

[Bugfix][BI] Keep piecewise cudagraphs out of batch-invariant runs

[BI] Warn when a decode step can escape the cudagraph capture set

[BI] Close the piecewise fallbacks the FULL pin does not cover

[BI] Refuse rather than override the other full-cudagraph blockers

[BI] Check for unsupported FULL before the pin, not inside it

[BI] Sample the capture-size choice before any model hook can fill it in

[BI] Describe the criterion the warning actually uses

[BI] Keep the capture-size answer across config rebuilds

[BI] Route dynamic speculative decoding through the same refusal

[BI] Close the last three full-cudagraph gaps

[BI] Refuse the multimodal encoder's own cudagraph dispatcher

[BI] Close the remaining independent cudagraph dispatchers

[BI] Check the mode-independent dispatchers independently of the mode

[BI] Disable encoder cudagraphs where the capability is known

[BI] Decide the encoder dispatcher after the capability it depends on

[BI][DSv4] Run test_batch_invariant_dispatchers.py in CI

[BI][DSv4] Run the dispatcher regressions when the code they cover changes

[BI] State what the piecewise pin buys, now that it is measurable

[BI] Stop pinning cudagraph_mode, and warn instead

[BI] Drop the encoder and Gemma4 dispatcher changes

Commits on Aug 19, 2026

[BI] Make the config checks exact about what they cover

[BI] Keep the @config decorator attached to VllmConfig

[BI] Give the microbatching tests a backend microbatching accepts