Fix sharding reshard bug and support reshard in different partition ways

[sneaxiy]

PR types

Bug fixes

PR changes

Others

Description

• Fix bugs of sharding reshard when tensor name is not kept after spawning another processes.
• Make sharding reshard support automatic reshard when the tensors are partitioned in different ways.

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 9.45946% with 67 lines in your changes missing coverage. Please review.

Project coverage is 55.21%. Comparing base (2a57101) to head (0c1e6ab).
Report is 34 commits behind head on incubate/paddlenlp-fleety.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/utils/reshard/sharding_v2.py	11.11%	40 Missing ⚠️
paddlenlp/trainer/utils/sharding_io.py	6.25%	15 Missing ⚠️
paddlenlp/trainer/trainer.py	7.69%	12 Missing ⚠️

Additional details and impacted files

@@                      Coverage Diff                      @@
##           incubate/paddlenlp-fleety    #8837      +/-   ##
=============================================================
- Coverage                      55.24%   55.21%   -0.04%     
=============================================================
  Files                            620      620              
  Lines                          96574    96636      +62     
=============================================================
+ Hits                           53351    53355       +4     
- Misses                         43223    43281      +58     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.