Skip to content

[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool for pooling entrypoints.#39763

Merged
DarkLight1337 merged 5 commits intovllm-project:mainfrom
noooop:pooling_entrypoints_using_thread_pool
Apr 14, 2026
Merged

[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool for pooling entrypoints.#39763
DarkLight1337 merged 5 commits intovllm-project:mainfrom
noooop:pooling_entrypoints_using_thread_pool

Commits

Commits on Apr 14, 2026