Skip to content

Fix gradient reduction issue when EP=1, EP=TP, and EGTP != GTP - #6080

Merged
philipcmonk merged 3 commits into
NVIDIA:mainfrom
philipcmonk:expert-norms
Aug 3, 2026
Merged

Fix gradient reduction issue when EP=1, EP=TP, and EGTP != GTP#6080
philipcmonk merged 3 commits into
NVIDIA:mainfrom
philipcmonk:expert-norms

Merge remote-tracking branch 'upstream/main' into expert-norms

10b6186
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 30, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO