Skip to content

[AMD] Add SGLANG_DISAGGREGATION_NUM_PRE_ALLOCATE_REQS env var for configurable KV transfer overlap#20410

Merged
HaiShaw merged 6 commits intosgl-project:mainfrom
ZhaiFeiyue:overlap_kv_transfer
Mar 30, 2026
Merged

[AMD] Add SGLANG_DISAGGREGATION_NUM_PRE_ALLOCATE_REQS env var for configurable KV transfer overlap#20410
HaiShaw merged 6 commits intosgl-project:mainfrom
ZhaiFeiyue:overlap_kv_transfer

Commits

Commits on Mar 18, 2026

Commits on Mar 27, 2026

Commits on Mar 30, 2026