Skip to content

[Core] Speed up decode by remove synchronizing operation in sampler#16436

Merged
WoosukKwon merged 3 commits intovllm-project:mainfrom
chanh:cnguyen/penalties
Apr 21, 2025
Merged

[Core] Speed up decode by remove synchronizing operation in sampler#16436
WoosukKwon merged 3 commits intovllm-project:mainfrom
chanh:cnguyen/penalties

Commits

Commits on Apr 10, 2025

Commits on Apr 11, 2025