Skip to content

Commit c877e7f

Browse files
luyuzhe111yangw-dev
authored andcommitted
[V1][Spec Dec Bug Fix] Respect Spec Dec Method Specification (vllm-project#16636)
Signed-off-by: Bryan Lu <[email protected]> Signed-off-by: Yang Wang <[email protected]>
1 parent 2f35558 commit c877e7f

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/config.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2341,7 +2341,9 @@ def __post_init__(self):
23412341
)
23422342

23432343
# Automatically detect the method
2344-
if "eagle-" in self.draft_model_config.model.lower():
2344+
if self.method == 'eagle':
2345+
pass
2346+
elif "eagle-" in self.draft_model_config.model.lower():
23452347
self.method = "eagle"
23462348
elif self.draft_model_config.hf_config.model_type == "medusa":
23472349
self.method = "medusa"

0 commit comments

Comments
 (0)