[Bugfix] Fix the issue where llm.generate cannot be called repeatedly after setting GuidedDecodingParams#16767

Merged

DarkLight1337 merged 3 commits intovllm-project:mainfrom

chaunceyjiang:guided_decoding

Apr 22, 2025

Commits on Apr 17, 2025

[Bugfix] Fix the issue where cannot be called repeatedly after setting .
chaunceyjiang
committed
Remember when struct output backend was set via `auto`
russellb
committed
Add test for re-use of sampling_params with the `auto` backend
russellb
committed