[Bugfix] Max-load throughput cliff when max_num_seqs is not a multiple of 8 - #57355

[Bugfix] Max-load throughput cliff when max_num_seqs is not a multiple of 8#57355

benchislett merged 3 commits into

vllm-project:mainvllm-project/vllm:mainfrom

andylolu2:fix/cudagraph-max-num-seqsandylolu2/vllm:fix/cudagraph-max-num-seqsCopy head branch name to clipboard