[Fix] Avoid pickling entire LLMEngine for Ray workers#3207
Merged
Yard1 merged 4 commits intovllm-project:mainfrom Mar 6, 2024
Merged
[Fix] Avoid pickling entire LLMEngine for Ray workers#3207Yard1 merged 4 commits intovllm-project:mainfrom
Yard1 merged 4 commits intovllm-project:mainfrom