[dev] feat(moe): Add KDA Low-Rank Projections and Extend MLA Support - #6877

[dev] feat(moe): Add KDA Low-Rank Projections and Extend MLA Support#6877

yuzhongw-nvidia wants to merge 12 commits into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

yuzhongw-nvidia:yuzhongw/kimi-k3-kdayuzhongw-nvidia/Megatron-LM:yuzhongw/kimi-k3-kdaCopy head branch name to clipboard