Skip to content

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp) - #30915

Merged
Fridge003 merged 2 commits into
sgl-project:mainfrom
MartinHua:feat/layernorm-sp-generalize
Sep 1, 2026
Merged

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp)#30915
Fridge003 merged 2 commits into
sgl-project:mainfrom
MartinHua:feat/layernorm-sp-generalize

test(layernorm_sp): unit guards/gating + e2e tp=2 gsm8k

fa37892
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
update-pr-body
succeeded Aug 30, 2026 in 7s