feat(sglang): engine fault tolerance for rollouts - #3187

Open

xiuhu17 wants to merge 8 commits into

NVIDIA-NeMo:mainfrom

xiuhu17:zhw/sglang_fault_tolerance

Commits on Aug 4, 2026

build(sglang): pin the sglang-miles branch, drop the TMS cuda-graph patch
xiuhu17
committed
f0fbfef

Commits on Aug 10, 2026

feat(sglang): megatron backend weight refit for sglang rollouts
xiuhu17
committed
1686ab1
fix(sglang): keep the SGLang refit dispatch out of the policy workers

Kh4L
authored and
xiuhu17
committed
00ea007
fix(sglang): avoid ncclCommSplit hang in the refit weight-update group

xiuhu17
and
Kh4L
committed
92ea352
refactor(sglang): route every SGLang refit through the weight synchronizer
xiuhu17
committed
d33bb46
build(sglang): align the sglang extra with the sglang-miles pins
xiuhu17
committed
8660879
test(sglang): add 1n4g sglang recipes for megatron and fsdp2
xiuhu17
committed
eac58ed
feat(sglang): engine fault tolerance for rollouts
xiuhu17
committed
f563fa9