small KTO fixes#1734

Merged

vwxyzjn merged 50 commits intohuggingface:mainfrom

Jun 17, 2024

Commits on Feb 26, 2024

speed up forward with no_grad for KL
kawine
committed

Commits on Feb 28, 2024

Commits on Feb 29, 2024

Commits on Mar 1, 2024

Commits on Mar 4, 2024

Commits on Mar 6, 2024

fix hanging issue in distributed training
kawine
committed

Commits on Mar 8, 2024

Commits on Mar 9, 2024

Merge branch 'huggingface:main' into main
kawine
authored

Commits on Mar 11, 2024

Merge branch 'huggingface:main' into main
kawine
authored

Commits on May 7, 2024

Merge branch 'main' of https://github.com/kawine/trl into main
xwinxu
committed

Commits on May 18, 2024

Merge branch 'huggingface:main' into main
xwinxu
authored

Commits on Jun 12, 2024

Merge branch 'huggingface:main' into main
kawine
authored

Commits on Jun 14, 2024

Commits on Jun 15, 2024