Move tests of experimental GRPO with replay buffer to tests/experimental#4329

albertvillanova merged 2 commits into

huggingface:mainhuggingface/trl:mainfrom

albertvillanova:fu-4060albertvillanova/trl:fu-4060Copy head branch name to clipboard