feat(sglang): tokens in/out with logprobs - #8119

Merged

Aphoh merged 28 commits into

mainfrom

warnold/sglang-tokens-inout

May 11, 2026

Commits on Apr 13, 2026

feat: cherry-pick tokenize/detokenize endpoints and token ID support from #7699
Aphoh
committed
127a14a
feat(sglang): support return_tokens_as_token_ids for token-based logprobs
Aphoh
committed
49a2140

Commits on Apr 14, 2026

feat: wire up return_tokens_as_token_ids for /v1/completions endpoint
Aphoh
committed
5664bf5

Commits on Apr 16, 2026

Commits on Apr 17, 2026

Commits on Apr 20, 2026

Merge origin/main into warnold/sglang-tokens-inout
Aphoh
committed
7a18d28

Commits on Apr 21, 2026

fix(completions): enable logprobs when logprobs=0 (chosen-token only)
Aphoh
committed
d013b5c

Commits on May 2, 2026

fix(sglang): trim token logprob branch scope
Aphoh
committed
6231dab

Commits on May 5, 2026

Commits on May 6, 2026

fix(openai): return stop_reason via nvext
Aphoh
committed
fd3c9e9

Commits on May 7, 2026

chore(openai): drop vllm logprob changes
Aphoh
committed
2dc3215
Merge remote-tracking branch 'origin/main' into warnold/sglang-tokens-inout
Aphoh
committed
b9d9fa3
docs(sglang): link top logprobs upstream fix
Aphoh
committed
0397bef
feat(openai): accept token id stop arrays
Aphoh
committed
ce704c1
fix(sglang): keep stop reasons in nvext
Aphoh
committed
4c97a5c
test(openai): encode stop input contract
Aphoh
committed
eda50cb
Merge remote-tracking branch 'origin/main' into warnold/sglang-tokens-inout
Aphoh
committed
9de617f
fix(openai): update echo choice calls
Aphoh
committed
3d5b5f8