Repository navigation

[Refactor] New EPD - #30398

Merged

ShangmingCai merged 67 commits into

sgl-project:mainfrom

liusy58:new_epd

Aug 21, 2026

Merged

[Refactor] New EPD#30398
ShangmingCai merged 67 commits into
sgl-project:mainfrom
liusy58:new_epd

Commits on Jul 7, 2026
- fix
  liusy58
  committed
  c3c8e7a
- fix
  liusy58
  committed
  4f13b4a
Commits on Jul 10, 2026
Commits on Jul 13, 2026
- Simplify encoder preprocessing call sites.
  cccccya
  committed
  1243401
- Merge pull request #2 from liusy58/cya/new_epd
  liusy58
  committed
  f67e967
Commits on Jul 14, 2026
- Unify encoder request orchestration
  cccccya
  committed
  f00b984
Commits on Jul 15, 2026
- Merge pull request #3 from liusy58/cya/new_epd
  liusy58
  committed
  704687f
Commits on Jul 24, 2026
- extract scheduler from encode server and DP runtime from HTTP server
  cccccya
  committed
  b51a697
- Merge pull request #6 from liusy58/cya/new_epd
  liusy58
  committed
  89cc075
Commits on Jul 27, 2026
- fix
  
  liusy58
  authored and
  Yuang Chen
  committed
  e276bb3
- Move launch_encoder, run_encoder, and worker request handling from
  Yuang Chen
  committed
  aee94ad
- fix
  
  liusy58
  authored and
  Yuang Chen
  committed
  007b704
- Replace direct MMEncoder state access with semantic methods.
  Yuang Chen
  committed
  b182eb4
- Return token counts and batch layout from encoder preprocessing.
  Yuang Chen
  committed
  ff03fc1
- Move dynamic ZMQ destination registration into MMEncoder.
  Yuang Chen
  committed
  446468c
- Simplify encoder preprocessing call sites.
  Yuang Chen
  committed
  0f435ea
- Unify encoder request orchestration
  Yuang Chen
  committed
  d3a9900
- Merge pull request #2 from liusy58/cya/new_epd
  
  liusy58
  authored and
  Yuang Chen
  committed
  ec84257
- extract scheduler from encode server and DP runtime from HTTP server
  Yuang Chen
  committed
  c5c1429
- Merge pull request #3 from liusy58/cya/new_epd
  
  liusy58
  authored and
  Yuang Chen
  committed
  cb4a2f8
- Merge pull request #6 from liusy58/cya/new_epd
  
  liusy58
  authored and
  Yuang Chen
  committed
  f8d0793
- Unify Mooncake and ZMQ per-request encode execution
  cccccya
  committed
  e29bc44
Commits on Jul 28, 2026
- fix code style
  cccccya
  committed
  03de2b2
- Merge pull request #7 from liusy58/cya/new_epd
  liusy58
  committed
  323c812
Commits on Jul 29, 2026
- Collect encoder request state into ReqState
  cccccya
  committed
  461a220
Commits on Jul 30, 2026
- Merge pull request #8 from liusy58/cya/new_epd
  liusy58
  authored
  ccedf11
- simplify mooncake backend
  ZhengWG
  committed
  b5f4063
- bug fix: keep unique key for dp & add sweep pending logic
  ZhengWG
  committed
  8520097
- Merge branch 'new_epd' into py/refactor-simplify-mooncake-backend
  ZhengWG
  committed
  400d701
Commits on Jul 31, 2026
- Merge pull request #10 from liusy58/py/refactor-simplify-mooncake-backend
  liusy58
  authored
  ddebe29
- Merge branch 'main' into new_epd
  ZhengWG
  committed
  9c9ac27
Commits on Aug 4, 2026
- refactor: combine encode/batch_encode
  ZhengWG
  committed
  d31c9e3
- feat: add reponse check for recv_embedding
  ZhengWG
  committed
  c2d7ded
- Merge pull request #12 from liusy58/py/refactor-simplify-code
  liusy58
  authored
  8c930b1
- Centralize encoder preprocessing metadata
  cccccya
  committed
  7bfbe29
- Merge pull request #9 from liusy58/cya/new_epd
  liusy58
  authored
  171b25d
Commits on Aug 5, 2026
- unify encoder inference lifecycle
  cccccya
  committed
  8e582ee
- Merge pull request #16 from liusy58/cya/new_epd
  liusy58
  authored
  dd2c0a9
Commits on Aug 6, 2026
- feat: add embeddingpool
  ZhengWG
  committed
  870dbb8
- refactor: move public func in WaitingImage class
  ZhengWG
  committed
  b795532
- refactor: abtract public class
  ZhengWG
  committed
  67548e4
- Merge branch 'new_epd' into py/refactor-add-embedding-pool
  ZhengWG
  committed
  bb66995
- refactor: clean mm_receiver path for zmq_to_tokenizer
  ZhengWG
  committed
  8f678e5
- Merge pull request #17 from liusy58/py/refactor-add-embedding-pool
  ZhengWG
  authored
  427141f
- Merge branch 'main' into cya/new_epd
  cccccya
  committed
  9448b86
- Merge pull request #18 from liusy58/cya/new_epd
  liusy58
  authored
  b289b1a
- Merge branch 'main' into new_epd
  liusy58
  authored
  c2d060e
Commits on Aug 7, 2026
- fix: route Mooncake metadata waits to encoder DP workers
  cccccya
  committed
  9852298
- fix: preserve request metadata when failing pending DP worker requests
  cccccya
  committed
  46016be
Commits on Aug 8, 2026
- Merge pull request #19 from liusy58/cya/new_epd_fix
  liusy58
  authored
  5fa9e65
Commits on Aug 10, 2026
- Merge branch 'main' into new_epd
  liusy58
  committed
  3cf3b41
- update
  liusy58
  committed
  8d93aaf
- fix
  liusy58
  committed
  25f0d95
- fix lint
  liusy58
  committed
  1fd1100
- Merge branch 'main' into new_epd
  siyu
  authored
  7e12fcb
Commits on Aug 12, 2026
- Merge branch 'main' into cya/new_epd
  cccccya
  committed
  22fc2bf
Commits on Aug 13, 2026
- Merge pull request #20 from liusy58/cya/new_epd
  liusy58
  authored
  93b52de
- Merge branch 'main' into new_epd
  cccccya
  committed
  c3b9633
Commits on Aug 14, 2026
- Merge branch 'main' into new_epd
  liusy58
  committed
  d83ebb8
Commits on Aug 17, 2026
- Merge branch 'main' into new_epd
  cccccya
  committed
  0f9b975
- Merge branch 'main' into new_epd
  siyu
  authored
  b933c38
Commits on Aug 18, 2026
- Merge branch 'main' into new_epd
  cccccya
  committed
  c2e18e5
Commits on Aug 20, 2026
- fix: Return 400 instead of AssertionError on receive_count mismatch
  ZhengWG
  committed
  175c641
Commits on Aug 21, 2026
- Merge branch 'main' into new_epd
  liusy58
  committed
  fbc77da

Commits

Commits on Jul 7, 2026

Commits on Jul 10, 2026

Commits on Jul 13, 2026

Commits on Jul 14, 2026

Commits on Jul 15, 2026

Commits on Jul 24, 2026

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Commits on Jul 29, 2026

Commits on Jul 30, 2026

Commits on Jul 31, 2026

Commits on Aug 4, 2026

Commits on Aug 5, 2026

Commits on Aug 6, 2026

Commits on Aug 7, 2026

Commits on Aug 8, 2026

Commits on Aug 10, 2026

Commits on Aug 12, 2026

Commits on Aug 13, 2026

Commits on Aug 14, 2026

Commits on Aug 17, 2026

Commits on Aug 18, 2026

Commits on Aug 20, 2026

Commits on Aug 21, 2026