Skip to content

fix(server): capture legal multi-request prefill CUDA graph batches - #30206

Merged
Oasis-Git merged 7 commits into
sgl-project:mainfrom
nvpohanh:fix-piecewise-cuda-graph-max-tokens
Aug 3, 2026
Merged

Oasis-Git merged 7 commits into
sgl-project:mainfrom
nvpohanh:fix-piecewise-cuda-graph-max-tokens

style(server): format prefill CUDA graph runner

334b1d3
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
update-pr-body
succeeded Jul 29, 2026 in 10s