[Bugfix] Use async preprocessing in pooling/embedding endpoints#38653
Closed
chuqiwang wants to merge 1 commit intovllm-project:mainfrom
Closed
[Bugfix] Use async preprocessing in pooling/embedding endpoints#38653chuqiwang wants to merge 1 commit intovllm-project:mainfrom
chuqiwang wants to merge 1 commit intovllm-project:mainfrom