Skip to content

[perf][bugfix] improve performance of rejection sampler and eliminate HD synchronize in TopKTopPSampler#4154

Merged
realliujiaxu merged 9 commits into
vllm-project:mainfrom
linfeng-yuan:upgrade_top_k_top_p_main
Dec 24, 2025
Merged

[perf][bugfix] improve performance of rejection sampler and eliminate HD synchronize in TopKTopPSampler#4154
realliujiaxu merged 9 commits into
vllm-project:mainfrom
linfeng-yuan:upgrade_top_k_top_p_main

Commits

Commits on Dec 22, 2025

Commits on Dec 23, 2025

Commits on Dec 24, 2025