Refactor KTO [1/N]: Modernize model initialization#4783

albertvillanova merged 1 commit intohuggingface:mainhuggingface/trl:mainfrom

albertvillanova:refactor-kto-1calbertvillanova/trl:refactor-kto-1cCopy head branch name to clipboard