Skip to content

[WIP] Use vllm transformers backend for pooling model runner. - #752

Closed
maxdebayser wants to merge 8 commits into
mainfrom
vllm_model_loader_pooling
Closed

[WIP] Use vllm transformers backend for pooling model runner.#752
maxdebayser wants to merge 8 commits into
mainfrom
vllm_model_loader_pooling