Skip to content

Commit d7a60a0

Browse files
njhillYuqi Zhang
authored andcommitted
[BugFix] Increase TP execute_model timeout (vllm-project#18558)
Signed-off-by: Nick Hill <[email protected]> Signed-off-by: Yuqi Zhang <[email protected]>
1 parent 7827fa9 commit d7a60a0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/v1/executor/multiproc_executor.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@
3838
POLLING_TIMEOUT_MS = 5000
3939
POLLING_TIMEOUT_S = POLLING_TIMEOUT_MS // 1000
4040

41-
EXECUTE_MODEL_TIMEOUT_S = 40
41+
EXECUTE_MODEL_TIMEOUT_S = 300
4242

4343

4444
class MultiprocExecutor(Executor):

0 commit comments

Comments
 (0)