[Dev] Fix for rope when enabling THD + Dynamic-CP; and use the naming Dynamic-CP. - #3405

[Dev] Fix for rope when enabling THD + Dynamic-CP; and use the naming Dynamic-CP.#3405

kunlunl merged 4 commits into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

xiaoyao0115:dynamic-cp-rename-and-fixxiaoyao0115/Megatron-LM:dynamic-cp-rename-and-fixCopy head branch name to clipboard