fix(loss): exclude -inf logprobs from the actor reduction, not the KL - #3551

fix(loss): exclude -inf logprobs from the actor reduction, not the KL#3551

tianyi-zhang-02 wants to merge 13 commits into

NVIDIA-NeMo:mainNVIDIA-NeMo/RL:mainfrom

tianyi-zhang-02:fix/neg-inf-logprob-masktianyi-zhang-02/RL:fix/neg-inf-logprob-maskCopy head branch name to clipboard