[Bugfix] Grammar was ignored when reasoning ended within speculated tokens#36138

Open

sfbemerk wants to merge 6 commits into

vllm-project:mainfrom

sfbemerk:bugfix/specdecode-grammar-reasoning-new

Commits on Apr 14, 2026

add tests that reproduce current bug: grammar not applied to post-reasoning speculated tokens
Benjamin Merkel
committed
fix structured output when reasoning ends in speculative tokens
Benjamin Merkel
committed
add test case for should_advance
Benjamin Merkel
committed
extract _validate_spec_tokens_with_reasoning as common method, following review suggestion
Benjamin Merkel
committed
fix pre-commit
Benjamin Merkel
committed
Fix edge case; refactoring.
Benjamin Merkel
committed