Repository navigation

[Perf][DSv4.1] Run decoder replay layers in CUDA graphs and trim in PIECEWISE graphs - #59532

Merged

ivanium merged 10 commits into

vllm-project:mainfrom

Juntian777:feat/dsv41-replay-cudagraph

Oct 6, 2026

Merged

[Perf][DSv4.1] Run decoder replay layers in CUDA graphs and trim in PIECEWISE graphs#59532
ivanium merged 10 commits into
vllm-project:mainfrom
Juntian777:feat/dsv41-replay-cudagraph

Commits on Oct 1, 2026
- [Perf][DSv4.1] Run decoder replay layers in CUDA graphs and trim in PIECEWISE graphs
  
  Juntian777
  and
  claude
  committed
  c834870
- add decoder cudagraph configs
  Juntian777
  committed
  df6c92b
- [Perf][DSv4.1] Build only the replay layers' metadata; trim from 768 tokens
  
  Juntian777
  and
  claude
  committed
  c7220f0
- [Perf][DSv4.1] Default replay graph sizes to 8 per power-of-two interval
  
  Juntian777
  and
  claude
  committed
  f21ea3c
Commits on Oct 2, 2026
- [Perf][DSv4.1] Add cudagraph_decoder_replay switch and trim threshold bound; clarify replay batch naming
  
  Juntian777
  and
  claude
  committed
  9b122bd
Commits on Oct 3, 2026
- [Perf][DSv4.1] Keep one replay row for an idle DP rank's dummy batch
  
  Juntian777
  and
  claude
  committed
  f61deaf
Commits on Oct 5, 2026
- Merge branch 'main' into feat/dsv41-replay-cudagraph
  mergify[bot]
  authored
  7c52deb
- [Perf][DSv4.1] Fake capture_inner_cudagraphs in the capture_model tests
  
  Juntian777
  and
  claude
  committed
  7f1df1b
- [Perf][DSv4.1] Start default replay graph sizes at the sliding window
  
  Juntian777
  and
  claude
  committed
  95ea212
Commits on Oct 6, 2026
- Merge branch 'main' into feat/dsv41-replay-cudagraph
  Juntian777
  authored
  0a9ae81