Skip to content

[Bugfix] Use async preprocessing in pooling/embedding endpoints - #38653

Closed
chuqiwang wants to merge 1 commit into
vllm-project:mainfrom
chuqiwang:fix/async-pooling-preprocessing
Closed

[Bugfix] Use async preprocessing in pooling/embedding endpoints#38653
chuqiwang wants to merge 1 commit into
vllm-project:mainfrom
chuqiwang:fix/async-pooling-preprocessing

Use async preprocessing in pooling/embedding endpoints

32b5564
Select commit
Loading
Failed to load commit list.