Modify DSV4 GB300 SGLang MTP disagg concurrency - #1316

Closed

yhyang201 wants to merge 14 commits into

mainfrom

tune-mtp-concurrency

Commits on May 12, 2026

Tune MTP disagg concurrency to reduce prefill queue buildup
yhyang201
committed
ba9e9c5
Add perf-changelog entry for MTP concurrency tuning
yhyang201
committed
f518a23
Add frontend.args with KV routing to all MTP recipes
yhyang201
committed
5ae9161

Commits on May 13, 2026

Add round_robin load balance for prefill DP ranks
yhyang201
committed
2b265fa
Add multiple concurrency levels for mid-curve configs
yhyang201
committed
62d4bc5
Add higher conc sweep points for 1P16D and 2P8D
yhyang201
committed
1f80fdc
Keep only max conc in conc-list for 1P16D and 2P8D
yhyang201
committed
bcdb5bf
Merge branch 'main' into tune-mtp-concurrency
yhyang201
authored
342ad5b
Update perf-changelog.yaml
yhyang201
authored
d27b086
Drop conc=64 from 1P16D sweep to fit conc=192 in time budget
yhyang201
committed
b824532
Finalize concurrency: keep only best conc per config
yhyang201
committed
ce7a0b2

Commits on May 14, 2026