Skip to content

Refactor KTO coordinated with DPO [a/N]: Remove encoder-decoder support#4792

Merged
albertvillanova merged 11 commits intohuggingface:mainfrom
albertvillanova:refactor-kto-coordinated-with-dpo-a
Jan 12, 2026
Merged

Refactor KTO coordinated with DPO [a/N]: Remove encoder-decoder support#4792
albertvillanova merged 11 commits intohuggingface:mainfrom
albertvillanova:refactor-kto-coordinated-with-dpo-a