don't merge - #5284

Draft

wplf wants to merge 8 commits into

wplf:jinliangl/gdn-conv-fusion-and-opt-rebased

Commits on Jun 11, 2026

[dev] feat(moe): add NVTX ranges to SharedExpertMLP for shared-expert overlap profiling
wplf
committed
3cb1910
fix(parallel_state): skip NCCL.Options under --fake-process-group
wplf
committed
d3028d7
feat(memory_snapshot): enable event recording (frames + device_traces)
wplf
committed
0189a8d
feat(moe): discard-output recompute for shared experts
wplf
committed
c790284
feat(fusions): fused mRoPE for Qwen3.5-VL (core)

wplf
and
Li Tao
committed
5e6a7bd
P7: GDN selective recompute (norm_out + qkv discard-output)
wplf
committed
b22ae91
feat(ssm): fused pre-gated-delta-rule (GDN conv fusion)

yuzhongw-nvidia
authored and
wplf
committed
995706d
feat(ssm): optional mcore_gdn_opt optimized kernels for GatedDeltaNet

wplf
and
byshiue
committed
a0dae6d