support_moe_sharding

[xuxinyi389]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description

[codecov]

Codecov Report

Attention: Patch coverage is 0% with 79 lines in your changes missing coverage. Please review.

Project coverage is 52.63%. Comparing base (fb3e4c0) to head (2b7cfcf).

Files with missing lines	Patch %	Lines
paddlenlp/trainer/utils/ckpt_converter.py	0.00%	78 Missing ⚠️
paddlenlp/trainer/auto_trainer.py	0.00%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9798      +/-   ##
===========================================
+ Coverage    51.53%   52.63%   +1.09%     
===========================================
  Files          741      730      -11     
  Lines       118972   115328    -3644     
===========================================
- Hits         61318    60700     -618     
+ Misses       57654    54628    -3026     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[paddle-bot]

Thanks for your contribution!