[Auto Parallel] Add auto parallel moe_layer

[pkuzyc]

PR types

New features

PR changes

Models

Description

Add auto parallel moe_layer

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 15.55556% with 380 lines in your changes missing coverage. Please review.

Project coverage is 51.28%. Comparing base (ac980d3) to head (c5b3e6d).
Report is 19 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/transformers/moe_gate_auto.py	11.58%	229 Missing ⚠️
paddlenlp/transformers/moe_layer_auto.py	20.00%	116 Missing ⚠️
...addlenlp/transformers/deepseek_v2/modeling_auto.py	27.50%	29 Missing ⚠️
paddlenlp/transformers/deepseek_v2/modeling.py	0.00%	6 Missing ⚠️

❌ Your patch status has failed because the patch coverage (15.55%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.
❌ Your project status has failed because the head coverage (51.28%) is below the target coverage (58.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9883      +/-   ##
===========================================
- Coverage    51.41%   51.28%   -0.14%     
===========================================
  Files          745      747       +2     
  Lines       118351   118791     +440     
===========================================
+ Hits         60856    60922      +66     
- Misses       57495    57869     +374     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.