Move OnlineDPOTrainer to experimental module#4473

qgallouedec merged 9 commits into

mainhuggingface/trl:mainfrom

refactor/move-online-dpo-to-experimentalhuggingface/trl:refactor/move-online-dpo-to-experimentalCopy head branch name to clipboard