Update max_num_tokens value when specdec is enabled#34671
Closed
shaharmor98 wants to merge 5 commits intovllm-project:mainfrom
Closed
Update max_num_tokens value when specdec is enabled#34671shaharmor98 wants to merge 5 commits intovllm-project:mainfrom
shaharmor98 wants to merge 5 commits intovllm-project:mainfrom