Deepseek v3 mla fp8

[ckl117]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 3.91426% with 1031 lines in your changes missing coverage. Please review.

Project coverage is 50.97%. Comparing base (235c24e) to head (67de793).
Report is 18 commits behind head on develop.

Files with missing lines	Patch %	Lines
...erimental/transformers/fused_transformer_layers.py	0.00%	556 Missing ⚠️
paddlenlp/ops/moe/fused_moe_triton/fused_moe.py	13.83%	218 Missing ⚠️
.../experimental/transformers/deepseek_v2/modeling.py	0.00%	149 Missing ⚠️
.../moe/fused_moe_triton/test_triton_fp8_fused_moe.py	0.00%	59 Missing ⚠️
paddlenlp/experimental/transformers/proposers.py	0.00%	9 Missing ⚠️
...enlp/experimental/transformers/generation_utils.py	0.00%	6 Missing ⚠️
...dlenlp/experimental/transformers/llama/modeling.py	0.00%	6 Missing ⚠️
...dlenlp/experimental/transformers/bloom/modeling.py	0.00%	5 Missing ⚠️
...p/experimental/transformers/chatglm_v2/modeling.py	0.00%	5 Missing ⚠️
...enlp/experimental/transformers/mixtral/modeling.py	0.00%	5 Missing ⚠️
... and 3 more

❌ Your patch check has failed because the patch coverage (3.91%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.
❌ Your project check has failed because the head coverage (50.97%) is below the target coverage (58.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9897      +/-   ##
===========================================
- Coverage    51.66%   50.97%   -0.70%     
===========================================
  Files          739      749      +10     
  Lines       117426   119529    +2103     
===========================================
+ Hits         60668    60925     +257     
- Misses       56758    58604    +1846     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.