[Bugfix] Treat max_tokens as output upper bound, not input-space reservation - #57035

[Bugfix] Treat max_tokens as output upper bound, not input-space reservation#57035

DarkLight1337 merged 8 commits into

vllm-project:mainvllm-project/vllm:mainfrom

YuvrajSinghBhadoria2:fix/max-tokens-not-reservationYuvrajSinghBhadoria2/vllm:fix/max-tokens-not-reservationCopy head branch name to clipboard