Skip to content

Allow 128 chat logprob candidates through the model gateway - #41373

Draft
Shi-Dong wants to merge 2 commits into
sgl-project:mainfrom
Shi-Dong:shi/score-centering-router-pr
Draft

Shi-Dong wants to merge 2 commits into
sgl-project:mainfrom
Shi-Dong:shi/score-centering-router-pr

Preserve session token inputs and replay metadata in chat routing

8587cf8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
label
succeeded Sep 26, 2026 in 6s