Batch detokenization across positions in detokenize_top_logprobs_tokens - #24447

Closed

Aphoh wants to merge 6 commits into

sgl-project:mainfrom

Aphoh:warnold/batch-detokenize-topk

Commits on May 5, 2026

Batch detokenization across positions in detokenize_top_logprobs_tokens
Aphoh
committed
eb9fa71
Merge remote-tracking branch 'origin/main' into warnold/batch-detokenize-topk
Aphoh
committed
9b6f8f1
Reuse detokenize_logprob_tokens in no-text branch
Aphoh
committed
f38d3e9
Preserve single-token batch_decode shape
Aphoh
committed
f9bbb88
Use tokenizer backend for batched logprob decode
Aphoh
committed
2985e84

Commits on May 11, 2026

Clean up batched logprob decode tests
Aphoh
committed
3fab100