Skip to content

Commit 9dae781

Browse files
config.py: Clarify that only local GGUF checkpoints are supported.
Signed-off-by: Mathieu Bordere <[email protected]>
1 parent 6a7988c commit 9dae781

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

vllm/transformers_utils/config.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -300,7 +300,10 @@ def get_config(
300300
" - For Hugging Face models: ensure the presence of a "
301301
"'config.json'.\n"
302302
" - For Mistral models: ensure the presence of a "
303-
"'params.json'.\n").format(model=model)
303+
"'params.json'.\n"
304+
"3. For GGUF: pass the local path of the GGUF checkpoint.\n"
305+
" Loading GGUF from a remote repo directly is not yet "
306+
"supported.\n").format(model=model)
304307

305308
raise ValueError(error_message) from e
306309

0 commit comments

Comments
 (0)