Code

Add deduplication of captions#1104

Code

Merged

bghira merged 1 commit intobghira:mainbghira/SimpleTuner:mainfrom mhirki:deduplicate-captionsmhirki/SimpleTuner:deduplicate-captionsCopy head branch name to clipboardOct 27, 2024

+3

Commits

Commits on Oct 27, 2024

• Add deduplication of captions by building a set which has superior performance for large datasets.

  mhirki

  committed
  f1b1073