Skip to content

[perf] v1/spec_decode: skip softmax for all-greedy rejection sampling#32852

Merged
benchislett merged 6 commits intovllm-project:mainfrom
caozuoba:perf/rejection-sampler-greedy
Jan 31, 2026
Merged

[perf] v1/spec_decode: skip softmax for all-greedy rejection sampling#32852
benchislett merged 6 commits intovllm-project:mainfrom
caozuoba:perf/rejection-sampler-greedy

Commits

Commits on Jan 30, 2026