Repository navigation

[Perf][DSv4.1] Trim the last KV-source layer in decoder replay - #59894

Merged

ivanium merged 8 commits into

vllm-project:mainfrom

gcanlin:perf/dsv41-cut-layer-trim

Oct 9, 2026

Merged

[Perf][DSv4.1] Trim the last KV-source layer in decoder replay#59894
ivanium merged 8 commits into
vllm-project:mainfrom
gcanlin:perf/dsv41-cut-layer-trim

Commits on Oct 6, 2026
- [Perf][DSV4.1] Decoder replay: replay the last KV source too
  
  gcanlin
  and
  claude
  committed
  60aaace
Commits on Oct 7, 2026
- [Bugfix][MRV2] Prepare PIECEWISE graph captures in PIECEWISE mode
  
  gcanlin
  and
  claude
  committed
  25537bc
Commits on Oct 8, 2026
- [Bugfix][DSV4.1] Break out to the decoder replay batch by graph size
  
  gcanlin
  and
  claude
  committed
  1ab937d
- Merge branch 'main' into perf/dsv41-cut-layer-trim
  
  gcanlin
  and
  claude
  committed
  08d17bc
- [Perf][DSv4.1] Skip wq_b in the cut layer's KV-only pass
  
  gcanlin
  and
  claude
  committed
  1d89d40
- [DSv4.1] Share the PIECEWISE replay policy between capture and runtime
  
  gcanlin
  and
  claude
  committed
  2af0ffd
Commits on Oct 9, 2026
- [DSv4.1] Simplify the cut-layer replay and pin its PIECEWISE policy
  
  Juntian777
  authored and
  gcanlin
  committed
  ffd52d5
- Merge branch 'main' into perf/dsv41-cut-layer-trim
  WoosukKwon
  authored
  afea542