Skip to content

[Perf] Parallelize fill_bitmask to accelerate high-throughput guided decoding#21862

Merged
vllm-bot merged 8 commits intovllm-project:mainfrom
CentML:ben/guided-speedups
Aug 6, 2025
Merged

[Perf] Parallelize fill_bitmask to accelerate high-throughput guided decoding#21862
vllm-bot merged 8 commits intovllm-project:mainfrom
CentML:ben/guided-speedups

Commits

Commits on Jul 28, 2025

Commits on Jul 29, 2025

Commits on Aug 5, 2025