Code

Val loss improvement#1903

Code

Open

kohya-ss wants to merge 14 commits intosd3kohya-ss/sd-scripts:sd3from val-loss-improvementkohya-ss/sd-scripts:val-loss-improvementCopy head branch name to clipboard

+260-210

Commits

Commits on Jan 27, 2025

• formatting

  kohya-ss

  committed
  532f5c5

  Copy full SHA for 532f5c5

• Fix gradient handling when Text Encoders are trained

  kohya-ss

  committed
  86a2f3f

  Copy full SHA for 86a2f3f

• call optimizer eval/train fn before/after validation

  kohya-ss

  committed
  b6a3093

  Copy full SHA for b6a3093

• add network.train()/eval() for validation

  kohya-ss

  committed
  29f31d0

  Copy full SHA for 29f31d0

• validation: Implement timestep-based validation processing

  kohya-ss

  committed
  0750859

  Copy full SHA for 0750859

• Merge branch 'sd3' into val-loss-improvement

  kohya-ss

  committed
  42c0a9e

  Copy full SHA for 42c0a9e

• use same noise for every validation

  kohya-ss

  committed
  45ec02b

  Copy full SHA for 45ec02b

Commits on Feb 4, 2025

• rng state management: Implement functions to get and set RNG states for consistent validation

  kohya-ss

  committed
  c5b803c

  Copy full SHA for c5b803c

• fix: validation timestep generation fails on SD/SDXL training

  kohya-ss

  committed
  a24db1d

  Copy full SHA for a24db1d

Commits on Feb 9, 2025

• set python random state

  kohya-ss

  committed
  0911683

  Copy full SHA for 0911683

• fix: validation with block swap

  kohya-ss

  committed
  344845b

  Copy full SHA for 344845b

Commits on Feb 11, 2025

• fix: unpause training progress bar after vaidation

  kohya-ss

  committed
  1772038

  Copy full SHA for 1772038

• fix: remove unused parameter 'accelerator' from encode_images_to_latents method

  kohya-ss

  committed
  cd80752

  Copy full SHA for cd80752

• fix: simplify validation step condition in NetworkTrainer

  kohya-ss

  committed
  76b7619

  Copy full SHA for 76b7619