Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support deepspeed #1101

Merged
merged 12 commits into from
Feb 27, 2024
Merged

support deepspeed #1101

merged 12 commits into from
Feb 27, 2024

Commits on Feb 3, 2024

  1. support deepspeed

    @BootsofLagrangian
    BootsofLagrangian committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    dfe08f3 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. fix offload_optimizer_device typo

    @BootsofLagrangian
    BootsofLagrangian committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    64873c1 View commit details
    Browse the repository at this point in the history

  2. fix vae type error during training sdxl

    @BootsofLagrangian
    BootsofLagrangian committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    2824312 View commit details
    Browse the repository at this point in the history

  3. fix all trainer about vae

    @BootsofLagrangian
    BootsofLagrangian committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    4295f91 View commit details
    Browse the repository at this point in the history

  4. maybe fix branch to run offloading

    @BootsofLagrangian
    BootsofLagrangian committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    3970bf4 View commit details
    Browse the repository at this point in the history

  5. apply offloading method runable for all trainer

    @BootsofLagrangian
    BootsofLagrangian committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    7d2a926 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. fix full_fp16 compatible and train_step

    @BootsofLagrangian
    BootsofLagrangian committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    6255661 View commit details
    Browse the repository at this point in the history

  2. remove test requirements

    @BootsofLagrangian
    BootsofLagrangian committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    2445a5b View commit details
    Browse the repository at this point in the history

  3. forgot setting mixed_precision for deepspeed. sorry

    @BootsofLagrangian
    BootsofLagrangian committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    a98feca View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. the reason not working grad accum steps found. it was becasue of my a… 

    …ccelerate settings
    @BootsofLagrangian
    BootsofLagrangian committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    03f0816 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. refactored codes, some function moved into train_utils.py

    @BootsofLagrangian
    BootsofLagrangian committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    4d5186d View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. Merge branch 'deep-speed' into deepspeed

    @kohya-ss
    kohya-ss authored Feb 27, 2024
    Configuration menu
    Copy the full SHA
    eefb3cc View commit details
    Browse the repository at this point in the history