Skip to content

[megatron] Fix loss aggregation for context parallelism (CP) in Megatron#1420

Merged
erictang000 merged 2 commits intomainfrom
megatron_cp_loss
Mar 31, 2026
Merged

[megatron] Fix loss aggregation for context parallelism (CP) in Megatron#1420
erictang000 merged 2 commits intomainfrom
megatron_cp_loss

Commits

Commits on Mar 31, 2026