Skip to content

fix: clamp max_new_tokens on retry to prevent response_length overflow - #2003

Open
YaoweiFan wants to merge 1 commit into
THUDM:mainfrom
YaoweiFan:fix/fully-async-retry-max-new-tokens
Open

fix: clamp max_new_tokens on retry to prevent response_length overflow#2003
YaoweiFan wants to merge 1 commit into
THUDM:mainfrom
YaoweiFan:fix/fully-async-retry-max-new-tokens

fix: clamp max_new_tokens on retry to prevent response_length overflow

426acc9
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Run pre-commit
succeeded Jun 1, 2026 in 51s