[Core] Speed up decode by remove synchronizing operation in sampler#16436
Merged
WoosukKwon merged 3 commits intovllm-project:mainfrom Apr 21, 2025
Merged
[Core] Speed up decode by remove synchronizing operation in sampler#16436WoosukKwon merged 3 commits intovllm-project:mainfrom
WoosukKwon merged 3 commits intovllm-project:mainfrom
Commits
Commits on Apr 10, 2025
- committed
Chanh Nguyen - committed
Chanh Nguyen
Commits on Apr 11, 2025
- committed
Chanh Nguyen