Skip to content

[Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine#20062

Merged
aarnphm merged 5 commits intovllm-project:mainfrom
izhuhaoran:fix-cuda_graph_sizes-v1
Jun 25, 2025
Merged

[Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine#20062
aarnphm merged 5 commits intovllm-project:mainfrom
izhuhaoran:fix-cuda_graph_sizes-v1

Commits

Commits on Jun 25, 2025