Skip to content

[Refactor] Leave the FFN reduction to the next layer under attention DP - #41197

Merged
ch-wan merged 2 commits into
mainfrom
cheng/refactor/dp-reduction-at-next-boundary
Sep 25, 2026
Merged

[Refactor] Leave the FFN reduction to the next layer under attention DP#41197
ch-wan merged 2 commits into
mainfrom
cheng/refactor/dp-reduction-at-next-boundary

Leave the FFN all-reduce to the next layer under attention DP as well

8791a56
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar