Skip to content

fix: clamp max_new_tokens on retry to prevent response_length overflow - #2003

Open
YaoweiFan wants to merge 1 commit into
THUDM:mainfrom
YaoweiFan:fix/fully-async-retry-max-new-tokens
Open

fix: clamp max_new_tokens on retry to prevent response_length overflow#2003
YaoweiFan wants to merge 1 commit into
THUDM:mainfrom
YaoweiFan:fix/fully-async-retry-max-new-tokens

Commits

Commits on Jun 1, 2026