[Fix][ROCm] MXFP4 MoE round-up inflates TP-sharded expert weights on CDNA3, starving KV cache - #56359

[Fix][ROCm] MXFP4 MoE round-up inflates TP-sharded expert weights on CDNA3, starving KV cache#56359

tjtanaa merged 6 commits into

vllm-project:mainvllm-project/vllm:mainfrom

EmbeddedLLM:bugfix-rocm-mxfp4-moe-roundupEmbeddedLLM/vllm:bugfix-rocm-mxfp4-moe-roundupCopy head branch name to clipboard