Skip to content

Commit 06869d9

Browse files
JustinTong0323jimoosciuc
authored andcommitted
[Fix] self.worker assignment in TpModelWorker and refactor references (sgl-project#4788)
Signed-off-by: Xinyuan Tong <[email protected]>
1 parent 78337fe commit 06869d9

File tree

2 files changed

+4
-8
lines changed

2 files changed

+4
-8
lines changed

python/sglang/srt/managers/scheduler.py

Lines changed: 2 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1943,18 +1943,12 @@ def handle_rpc_request(self, recv_req: RpcReqInput):
19431943
def save_remote_model(self, params):
19441944
url = params["url"]
19451945

1946-
if isinstance(self.tp_worker, TpModelWorkerClient):
1947-
worker = self.tp_worker.worker
1948-
else:
1949-
worker = self.tp_worker
1946+
worker = self.tp_worker.worker
19501947

19511948
worker.model_runner.save_remote_model(url)
19521949

19531950
def save_sharded_model(self, params):
1954-
if isinstance(self.tp_worker, TpModelWorkerClient):
1955-
worker = self.tp_worker.worker
1956-
else:
1957-
worker = self.tp_worker
1951+
worker = self.tp_worker.worker
19581952

19591953
worker.model_runner.save_sharded_model(
19601954
path=params["path"],

python/sglang/srt/managers/tp_worker.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -53,6 +53,8 @@ def __init__(
5353
req_to_token_pool: Optional[ReqToTokenPool] = None,
5454
token_to_kv_pool_allocator: Optional[TokenToKVPoolAllocator] = None,
5555
):
56+
self.worker = self
57+
5658
# Parse args
5759
self.tp_rank = tp_rank
5860

0 commit comments

Comments
 (0)