Skip to content

[Model Runner V2] Add full cuda graph support for eagle prefill - #37588

Merged
WoosukKwon merged 2 commits into
vllm-project:mainfrom
TheEpicDolphin:gdelfin/mrv2-eagle-full-pw-cudagraph-support
Apr 13, 2026
Merged

[Model Runner V2] Add full cuda graph support for eagle prefill#37588
WoosukKwon merged 2 commits into
vllm-project:mainfrom
TheEpicDolphin:gdelfin/mrv2-eagle-full-pw-cudagraph-support

only use decode cudagraph mode for draft generation, and add comments…

a09b1ee
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Apr 10, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync