Refactor KTO coordinated with DPO [b/N]: Simplify truncation logic#4808

albertvillanova merged 3 commits intohuggingface:mainhuggingface/trl:mainfrom

albertvillanova:refactor-kto-coordinated-with-dpo-balbertvillanova/trl:refactor-kto-coordinated-with-dpo-bCopy head branch name to clipboard