Skip to content

Conversation

@WYB27
Copy link
Collaborator

@WYB27 WYB27 commented Sep 17, 2025

修复glm4moe tp+ep+sp不能正常训练的问题

已修复:

  1. 开sp后的reshape报错问题
  2. 开sp后ep内部维度报错问题

todo:
_cal_seq_aux_loss函数,为适配sp维度而临时改动,未验证正确性,当前场景暂不需要计算aux_loss,后续需要时需验证正确性

@paddle-bot
Copy link

paddle-bot bot commented Sep 17, 2025

Thanks for your contribution!

@codecov-commenter
Copy link

codecov-commenter commented Sep 17, 2025

Codecov Report

❌ Patch coverage is 0% with 21 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (develop@a97e93f). Learn more about missing BASE report.

Files with missing lines Patch % Lines
paddleformers/transformers/moe_gate.py 0.00% 18 Missing ⚠️
paddleformers/transformers/glm4_moe/modeling.py 0.00% 3 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             develop    #2621   +/-   ##
==========================================
  Coverage           ?   29.50%           
==========================================
  Files              ?      312           
  Lines              ?    54626           
  Branches           ?        0           
==========================================
  Hits               ?    16119           
  Misses             ?    38507           
  Partials           ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@gongel gongel merged commit 2007ac0 into PaddlePaddle:develop Oct 1, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants