Skip to content
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions vllm/entrypoints/openai/models/serving.py
Original file line number Diff line number Diff line change
Expand Up @@ -196,6 +196,9 @@ async def load_lora_adapter(
) from e
raise

# Reset load_inplace before caching so the flag does not leak to
# subsequent generate requests.
lora_request.load_inplace = False
self.lora_requests[lora_name] = lora_request
logger.info(
"Loaded new LoRA adapter: name '%s', path '%s'", lora_name, lora_path
Expand Down
Loading