Skip to content

[Core] Add soft thinking token budget with progressive logit bias - #38277

Closed
efortin wants to merge 2 commits into
vllm-project:mainfrom
efortin:feat/soft-thinking-token-budget
Closed

[Core] Add soft thinking token budget with progressive logit bias#38277
efortin wants to merge 2 commits into
vllm-project:mainfrom
efortin:feat/soft-thinking-token-budget

Keep the soft bias in torch ops and bias only the next close token

ad576f0
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Jun 15, 2026 in 0s

There is no internal Diff connected, this can be merged now