Skip to content

[Structured Outputs] Make auto pick one backend per server instead of per request - #62877

Draft
BugenZhao wants to merge 1 commit into
vllm-project:mainfrom
BugenZhao:bz/structured-output-auto-no-fallback
Draft

[Structured Outputs] Make auto pick one backend per server instead of per request#62877
BugenZhao wants to merge 1 commit into
vllm-project:mainfrom
BugenZhao:bz/structured-output-auto-no-fallback

[Structured Outputs] Resolve `auto` from the tokenizer, without per-r…

b6cd8b9
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Oct 21, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync