Skip to content

Possible fix for conflict between Automated Prefix Caching (#2762) and multi-LoRA support (#1804)#3263

Merged
Yard1 merged 2 commits intovllm-project:mainfrom
VectorInstitute:prefix-caching-lora-block-conflict-fix
Mar 7, 2024
Merged

Possible fix for conflict between Automated Prefix Caching (#2762) and multi-LoRA support (#1804)#3263
Yard1 merged 2 commits intovllm-project:mainfrom
VectorInstitute:prefix-caching-lora-block-conflict-fix

Commits