[1/N][Feat] Cut down memory usage for o_proj in DeepSeek#2931

wangxiyuan merged 4 commits into

vllm-project:mainvllm-project/vllm-ascend:mainfrom

clrs97:layer-shard-linearclrs97/vllm-ascend-mla-sp:layer-shard-linearCopy head branch name to clipboard