Enabled fused grouped MLP for quick_gelu and add config for grouped params - #4219

Enabled fused grouped MLP for quick_gelu and add config for grouped params#4219

yaox12 merged 6 commits into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

ksivaman:fused_grouped_mlp_updatesksivaman/Megatron-LM:fused_grouped_mlp_updatesCopy head branch name to clipboard