Skip to content

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user#6954

Merged
simon-mo merged 4 commits intovllm-project:mainfrom
zifeitong:fix_max_tokens
Aug 1, 2024
Merged

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user#6954
simon-mo merged 4 commits intovllm-project:mainfrom
zifeitong:fix_max_tokens

Commits

Commits on Jul 30, 2024

Commits on Jul 31, 2024