Skip to content

[Core] Support thread-based async tokenizer pools#3449

Closed
njhill wants to merge 4 commits intovllm-project:mainfrom
njhill:async_tokenization2
Closed

[Core] Support thread-based async tokenizer pools#3449
njhill wants to merge 4 commits intovllm-project:mainfrom
njhill:async_tokenization2

Commits

Commits on Mar 19, 2024