Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
c3c8e7a
fix
Jul 7, 2026
4f13b4a
fix
Jul 7, 2026
94f87c9
Move launch_encoder, run_encoder, and worker request handling from
cccccya Jul 10, 2026
a656f1c
Replace direct MMEncoder state access with semantic methods.
cccccya Jul 10, 2026
73f6cfe
Return token counts and batch layout from encoder preprocessing.
cccccya Jul 10, 2026
5c189b0
Move dynamic ZMQ destination registration into MMEncoder.
cccccya Jul 10, 2026
1243401
Simplify encoder preprocessing call sites.
cccccya Jul 13, 2026
f67e967
Merge pull request #2 from liusy58/cya/new_epd
liusy58 Jul 13, 2026
f00b984
Unify encoder request orchestration
cccccya Jul 14, 2026
704687f
Merge pull request #3 from liusy58/cya/new_epd
liusy58 Jul 15, 2026
b51a697
extract scheduler from encode server and DP runtime from HTTP server
cccccya Jul 24, 2026
89cc075
Merge pull request #6 from liusy58/cya/new_epd
liusy58 Jul 24, 2026
e276bb3
fix
Jul 7, 2026
aee94ad
Move launch_encoder, run_encoder, and worker request handling from
Jul 10, 2026
007b704
fix
Jul 7, 2026
b182eb4
Replace direct MMEncoder state access with semantic methods.
Jul 10, 2026
ff03fc1
Return token counts and batch layout from encoder preprocessing.
Jul 10, 2026
446468c
Move dynamic ZMQ destination registration into MMEncoder.
Jul 10, 2026
0f435ea
Simplify encoder preprocessing call sites.
Jul 13, 2026
d3a9900
Unify encoder request orchestration
Jul 14, 2026
ec84257
Merge pull request #2 from liusy58/cya/new_epd
liusy58 Jul 13, 2026
c5c1429
extract scheduler from encode server and DP runtime from HTTP server
Jul 24, 2026
cb4a2f8
Merge pull request #3 from liusy58/cya/new_epd
liusy58 Jul 15, 2026
f8d0793
Merge pull request #6 from liusy58/cya/new_epd
liusy58 Jul 24, 2026
e29bc44
Unify Mooncake and ZMQ per-request encode execution
cccccya Jul 27, 2026
03de2b2
fix code style
cccccya Jul 28, 2026
323c812
Merge pull request #7 from liusy58/cya/new_epd
liusy58 Jul 28, 2026
461a220
Collect encoder request state into ReqState
cccccya Jul 29, 2026
ccedf11
Merge pull request #8 from liusy58/cya/new_epd
liusy58 Jul 30, 2026
b5f4063
simplify mooncake backend
ZhengWG Jul 30, 2026
8520097
bug fix: keep unique key for dp & add sweep pending logic
ZhengWG Jul 30, 2026
400d701
Merge branch 'new_epd' into py/refactor-simplify-mooncake-backend
ZhengWG Jul 30, 2026
ddebe29
Merge pull request #10 from liusy58/py/refactor-simplify-mooncake-bac…
liusy58 Jul 31, 2026
9c9ac27
Merge branch 'main' into new_epd
ZhengWG Jul 31, 2026
d31c9e3
refactor: combine encode/batch_encode
ZhengWG Aug 4, 2026
c2d7ded
feat: add reponse check for recv_embedding
ZhengWG Aug 4, 2026
8c930b1
Merge pull request #12 from liusy58/py/refactor-simplify-code
liusy58 Aug 4, 2026
7bfbe29
Centralize encoder preprocessing metadata
cccccya Jul 30, 2026
171b25d
Merge pull request #9 from liusy58/cya/new_epd
liusy58 Aug 4, 2026
8e582ee
unify encoder inference lifecycle
cccccya Aug 5, 2026
dd2c0a9
Merge pull request #16 from liusy58/cya/new_epd
liusy58 Aug 5, 2026
870dbb8
feat: add embeddingpool
ZhengWG Aug 6, 2026
b795532
refactor: move public func in WaitingImage class
ZhengWG Aug 6, 2026
67548e4
refactor: abtract public class
ZhengWG Aug 6, 2026
bb66995
Merge branch 'new_epd' into py/refactor-add-embedding-pool
ZhengWG Aug 6, 2026
8f678e5
refactor: clean mm_receiver path for zmq_to_tokenizer
ZhengWG Aug 6, 2026
427141f
Merge pull request #17 from liusy58/py/refactor-add-embedding-pool
ZhengWG Aug 6, 2026
9448b86
Merge branch 'main' into cya/new_epd
cccccya Aug 6, 2026
b289b1a
Merge pull request #18 from liusy58/cya/new_epd
liusy58 Aug 6, 2026
c2d060e
Merge branch 'main' into new_epd
liusy58 Aug 6, 2026
9852298
fix: route Mooncake metadata waits to encoder DP workers
cccccya Aug 7, 2026
46016be
fix: preserve request metadata when failing pending DP worker requests
cccccya Aug 7, 2026
5fa9e65
Merge pull request #19 from liusy58/cya/new_epd_fix
liusy58 Aug 8, 2026
3cf3b41
Merge branch 'main' into new_epd
Aug 10, 2026
8d93aaf
update
Aug 10, 2026
25f0d95
fix
Aug 10, 2026
1fd1100
fix lint
Aug 10, 2026
7e12fcb
Merge branch 'main' into new_epd
Aug 10, 2026
22fc2bf
Merge branch 'main' into cya/new_epd
cccccya Aug 12, 2026
93b52de
Merge pull request #20 from liusy58/cya/new_epd
liusy58 Aug 13, 2026
c3b9633
Merge branch 'main' into new_epd
cccccya Aug 13, 2026
d83ebb8
Merge branch 'main' into new_epd
Aug 14, 2026
0f9b975
Merge branch 'main' into new_epd
cccccya Aug 17, 2026
b933c38
Merge branch 'main' into new_epd
Aug 17, 2026
c2e18e5
Merge branch 'main' into new_epd
cccccya Aug 18, 2026
175c641
fix: Return 400 instead of AssertionError on receive_count mismatch
ZhengWG Aug 20, 2026
fbc77da
Merge branch 'main' into new_epd
Aug 21, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 1 addition & 2 deletions .github/CODEOWNERS
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,7 @@
/python/sglang/srt/constrained @hnyls2002 @DarkSharpness @JustinTong0323
/python/sglang/srt/disaggregation @ByronHsu @hnyls2002 @ShangmingCai @HaiShaw @Duyi-Wang @sogalin
/python/sglang/srt/disaggregation/ascend @ping1jing2 @iforgetmyname
/python/sglang/srt/disaggregation/encode_receiver.py @ShangmingCai @liusy58 @ZhengWG @gty111
/python/sglang/srt/disaggregation/encode_server.py @ShangmingCai @liusy58 @ZhengWG @gty111
/python/sglang/srt/disaggregation/encoder @ShangmingCai @liusy58 @ZhengWG @gty111
/python/sglang/srt/disaggregation/mori @Duyi-Wang @kkHuang-amd @HaiShaw @Lzy17 @billishyahao
/python/sglang/srt/distributed @yizhang2077 @merrymercy @ch-wan
/python/sglang/srt/distributed/device_communicators/mooncake_transfer_engine.py @ShangmingCai @stmatengss
Expand Down
4 changes: 2 additions & 2 deletions python/sglang/launch_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,13 +18,13 @@ def run_server(server_args):
if server_args.encoder_only:
# For encoder disaggregation
if server_args.smg_grpc_mode or server_args.grpc_mode:
from sglang.srt.disaggregation.encode_grpc_server import (
from sglang.srt.disaggregation.encoder.grpc_server import (
serve_grpc_encoder,
)

asyncio.run(serve_grpc_encoder(server_args))
else:
from sglang.srt.disaggregation.encode_server import launch_server
from sglang.srt.disaggregation.encoder.http_server import launch_server

launch_server(server_args)
elif server_args.smg_grpc_mode:
Expand Down
Loading
Loading