Repository navigation

feat(wideep): multi-node wide expert parallelism on top of #1603 - #1942

Draft

JiaoliangYu wants to merge 12 commits into

JiaoliangYu:wideep

Draft

feat(wideep): multi-node wide expert parallelism on top of #1603#1942
JiaoliangYu wants to merge 12 commits into
ROCm:mainfrom
JiaoliangYu:wideep

Commits on Aug 25, 2026
- feat: wideep_01: topo
  JiaoliangYu
  committed
  365d422
- clean code
  JiaoliangYu
  committed
  e8e64c2
- fix(wideep): make topology a derived view over ParallelConfig
  JiaoliangYu
  committed
  ff9d013
- test(eplb): cover the never-executed hierarchical placement path
  JiaoliangYu
  committed
  96a9dfb
- feat(wideep): derive EPLB's node count from the topology
  JiaoliangYu
  committed
  c39f2e8
- feat(wideep): count and cap EPLB's cross-node migration traffic
  JiaoliangYu
  committed
  83ecc47
- feat(wideep): reject unverified feature combinations under multi-node DP
  JiaoliangYu
  committed
  3cc8e9c
- feat(wideep): assert gpu_per_node and set MoRI's multi-node environment
  JiaoliangYu
  committed
  81964cf
- feat(wideep): one greppable topology line per worker at startup
  JiaoliangYu
  committed
  f0131e4
- feat(wideep): bound the barriers multi-node hangs on, and level KV pools
  JiaoliangYu
  committed
  32240db
- feat(wideep): give the weight prefetch a node-local rank
  JiaoliangYu
  committed
  345c20a
Commits on Sep 10, 2026
- feat(wideep): use AITER inter-node MoE for EP16
  JiaoliangYu
  committed
  b8f9341