feat(sglang): add end-to-end training and refit integration - #3330

Draft

Kh4L wants to merge 41 commits into

NVIDIA-NeMo:mainfrom

Kh4L:integration/sglang-training-shareable

Commits on Jul 28, 2026

feat(sglang): engine fault tolerance for rollouts

xiuhu17
authored and
Kh4L
committed
e41355a
feat(sglang): megatron backend weight refit for sglang rollouts

xiuhu17
authored and
Kh4L
committed
71da02b
feat(sglang): mxfp8 quantized rollout and refit

xiuhu17
authored and
Kh4L
committed
93e6528
fix(sglang): avoid ncclCommSplit hang in the refit weight-update group

xiuhu17
and
Kh4L
committed
f973a05
feat(sglang): enable async-GRPO NeMo-Gym rollouts on the SGLang backend
Kh4L
committed
27c5771
fix(sglang): dispatch NeMo-Gym context limit on backend, not vllm_cfg presence
Kh4L
committed
b34f09c
fix(sglang): harden async Gym config handling
Kh4L
committed
923767e
feat(nemo-gym): opt-in truncation of non-contiguous rollout episodes
Kh4L
committed
8eb5665
fix(nemo-gym): drop call-site default for truncate_noncontiguous_episodes
Kh4L
committed
ba15f2e
fix(nemo-gym): centralize rollout contiguity defaults
Kh4L
committed
3fc6bb0
fix(sglang): preserve runtime ownership across serialization
Kh4L
committed
d239fe2
fix(sglang): require cache invalidation before refit
Kh4L
committed
d7146f5
feat(sglang): emit refit lifecycle markers
Kh4L
committed
4eed998
test(sglang): cover async backend selection and refit loop
Kh4L
committed
7b58232
fix(sglang): validate runtime configuration
Kh4L
committed
9bb7632
docs(sglang): add reproducible training and refit recipes
Kh4L
committed
00f5e8f
fix(sglang): bound and recover distributed refits
Kh4L
committed
e9acf7c
fix(sglang): harden async backend lifecycle
Kh4L
committed
b1b7964
fix(sglang): fail closed across startup and refit
Kh4L
committed
06d7c7a
docs(sglang): add strict public refit reproducers
Kh4L
committed
706cde2
fix(sglang): make public evidence revision-exact
Kh4L
committed
74dedda
chore(gym): pin NeMo-Gym submodule to the token-exact SGLang adapter
Kh4L
committed
fab0ade
fix(sglang): dispatch the SGLang refit without importing a policy worker
Kh4L
committed
36d936f
fix(sglang): make the refit reproducers runnable and their checks collectable
Kh4L
committed
e7c0da7
test(sglang): add a four-GPU-per-node async Gym recipe variant
Kh4L
committed
85dceea
fix(sglang): declare uv_venv_dir so the async Gym recipes compose
Kh4L
committed
055fb13
fix(sglang): leave refit headroom on the async Gym engines
Kh4L
committed
eeec20c
fix(tools): refresh code snapshots instead of silently reusing them
Kh4L
committed
9ce8444
fix(nemo-gym): correct the TRT-LLM rejection message
Kh4L
committed
0c9d91b
docs(sglang): state the validated target and the cluster prerequisites
Kh4L
committed
c7d1d08

Commits on Jul 29, 2026

fix(tools): keep submodule trees out of the code snapshot
Kh4L
committed
edcd55a

Commits on Aug 3, 2026

Commits on Aug 5, 2026

Commits on Aug 10, 2026

Commits on Aug 11, 2026