Skip to content

[Fix] Avoid pickling entire LLMEngine for Ray workers#3207

Merged
Yard1 merged 4 commits intovllm-project:mainfrom
njhill:dont-pickle-engine
Mar 6, 2024
Merged

[Fix] Avoid pickling entire LLMEngine for Ray workers#3207
Yard1 merged 4 commits intovllm-project:mainfrom
njhill:dont-pickle-engine

Commits

Commits on Mar 5, 2024