Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -167,6 +167,7 @@ launch_joiner() {
--elastic-ep-backend mooncake --mooncake-ib-device $IB_DEVICE \
--enable-eplb --ep-num-redundant-experts 24 \
--elastic-ep-initial-size 4 --max-ep-size 8 \
--cuda-graph-backend-decode disabled --cuda-graph-backend-prefill disabled \
--elastic-ep-join-mode scale --elastic-ep-join-rank-offset $rank_offset \
--dist-init-addr $DIST_INIT_ADDR \
--host 127.0.0.1 --port $((30000 + rank_offset)) \
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@
# --mooncake-ib-device to the node's IB device list before applying.
# * DYN_SYSTEM_ENABLED=true so the leader exposes the :9090 system server that
# serves /engine/control/*.
# * BOTH the decode and the prefill CUDA graph disabled, passed explicitly
# below: SGLang asserts this for elastic-EP scale-up and exits on startup.
#
# The joining group is NOT launched by the operator yet (that orchestration is
# tracked separately). The accompanying run_sglang_elastic_ep_scale_up_test.sh
Expand Down Expand Up @@ -128,6 +130,10 @@ spec:
- "4"
- --max-ep-size
- "8"
- --cuda-graph-backend-decode
- disabled
- --cuda-graph-backend-prefill
- disabled
# Stable rendezvous address the joining group dials on scale-up.
# Sourced from SGLANG_ELASTIC_SCALE_DIST_INIT (single source of truth).
- --dist-init-addr
Expand Down
Loading