Repository navigation

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp) - #30915

Merged

Fridge003 merged 2 commits into

sgl-project:mainfrom

MartinHua:feat/layernorm-sp-generalize

Sep 1, 2026

Merged

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp)#30915
Fridge003 merged 2 commits into
sgl-project:mainfrom
MartinHua:feat/layernorm-sp-generalize

Commits on Aug 30, 2026
- Add --enable-layernorm-sp: Megatron LayerNorm sequence parallelism
  MartinHua
  committed
  ed1541b
- test(layernorm_sp): unit guards/gating + e2e tp=2 gsm8k
  MartinHua
  committed
  fa37892