Skip to content

[Bugfix] Max-load throughput cliff when max_num_seqs is not a multiple of 8 - #57355

Merged
benchislett merged 3 commits into
vllm-project:mainfrom
andylolu2:fix/cudagraph-max-num-seqs
Sep 17, 2026
Merged

[Bugfix] Max-load throughput cliff when max_num_seqs is not a multiple of 8#57355
benchislett merged 3 commits into
vllm-project:mainfrom
andylolu2:fix/cudagraph-max-num-seqs

Merge branch 'main' into fix/cudagraph-max-num-seqs

91d92cc
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Sep 17, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync