Skip to content

[Bugfix] Treat max_tokens as output upper bound, not input-space reservation - #57035

Merged
DarkLight1337 merged 8 commits into
vllm-project:mainfrom
YuvrajSinghBhadoria2:fix/max-tokens-not-reservation
Oct 9, 2026
Merged

[Bugfix] Treat max_tokens as output upper bound, not input-space reservation#57035
DarkLight1337 merged 8 commits into
vllm-project:mainfrom
YuvrajSinghBhadoria2:fix/max-tokens-not-reservation

Merge branch 'main' into fix/max-tokens-not-reservation

a8ba459
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Oct 9, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync