[Spec] Enable draft extend cuda graph for DeepSeek-V4 attention backend - #30853
Conversation
|
/rerun-test test_deepseek_v4_flash_fp8_h200.py |
|
Results for 🚀 |
There was a problem hiding this comment.
Code Review
This pull request updates eagle_worker_v2.py to import and add DeepseekV4AttnBackend to the list of supported backend types for CUDA graph capture. I have no feedback to provide as there are no review comments and the changes are straightforward.
Important
The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.
|
/rerun-test test_deepseek_v4_flash_fp4_b200.py test_deepseek_v4_flash_fp4_h200.py test_deepseek_v4_flash_fp4_megamoe_b200.py |
|
Results for 🚀 🚀 |
|
FYI, this change appears to make Comparison:
The effective server args for the comparable DeepSeek-V4 + DeepEP + CP server are essentially the same. Both runs also disable prefill CUDA graph for DeepSeek-V4, so this is not from prefill BCG: The key log difference is that the failing run, which includes this commit, captures draft-extend CUDA graph: The passing comparison run does not show The failing run then OOMs during EAGLE draft extend in Based on the code diff, the direct trigger is adding |
DeepseekV4AttnBackend already implements the DRAFT_EXTEND graph bucket (capture + replay); register it in the EAGLE draft worker's supported list so draft extend runs under cuda graph instead of eager.
Verification: test_deepseek_v4_flash_fp8_h200.py (TP=4 + EAGLE) exercises this path -- graph capture happens at server startup, so the test passing covers capture and replay.
CI States
Latest PR Test (Base): ❌ Run #29147214733
Latest PR Test (Extra): ❌ Run #29147214595