Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support HunYuan DiT #1378

Draft
wants to merge 21 commits into
base: dev
Choose a base branch
from
Draft

support HunYuan DiT #1378

wants to merge 21 commits into from
+3,733 −12

Commits on Jun 21, 2024

  1. Init implementation

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    9f432ea View commit details
    Browse the repository at this point in the history

  2. typo

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    dabb22f View commit details
    Browse the repository at this point in the history

  3. Remove redundant reshape

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    148756d View commit details
    Browse the repository at this point in the history

  4. add get_input_ids/get_hidden_states for t5

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    48f7739 View commit details
    Browse the repository at this point in the history

  5. better impl to fit Kohya style

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    dc6c97e View commit details
    Browse the repository at this point in the history

  6. Init model loader

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    efe4943 View commit details
    Browse the repository at this point in the history

  7. Delete test.png

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    b6073ac View commit details
    Browse the repository at this point in the history

  8. Some improvements

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    e30c503 View commit details
    Browse the repository at this point in the history

  9. Update hunyuan_test.py

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    09620b4 View commit details
    Browse the repository at this point in the history

  10. A quick conversion of train_network from sdxl ver

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    982cf79 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2024

  1. initial support of lycoris/lora + hunyuan dit

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 22, 2024
    Configuration menu
    Copy the full SHA
    fb3e8a7 View commit details
    Browse the repository at this point in the history

  2. Remove debug print

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 22, 2024
    Configuration menu
    Copy the full SHA
    32f15c9 View commit details
    Browse the repository at this point in the history

  3. Support train TE

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 22, 2024
    Configuration menu
    Copy the full SHA
    6155efc View commit details
    Browse the repository at this point in the history

  4. Fix NaN error

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 22, 2024
    Configuration menu
    Copy the full SHA
    580b489 View commit details
    Browse the repository at this point in the history

  5. Add lycoris sample code

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 22, 2024
    Configuration menu
    Copy the full SHA
    945688d View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. move load scheduler to method

    @KohakuBlueleaf
    KohakuBlueleaf committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    c0a936e View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. We add lora in DiT blocks and CLIP text encoder layers. (#5) 

    * support hunyuan lora in CLIP text encoder and DiT blocks

* add hunyuan lora test script

* append lora blocks in target module

---------

Co-authored-by: leoriojhli <[email protected]>
    @xljh0520
    xljh0520 and leoriojhli committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    5598cfd View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2024

  1. Support HunyuanDiT finetuning all parameters (#6)

    @Jarvis73
    Jarvis73 committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    4141c7a View commit details
    Browse the repository at this point in the history

  2. Support HunYuanDiT v1.1 and v1.2 lora (#8) 

    * support hunyuan lora in CLIP text encoder and DiT blocks

* add hunyuan lora test script

* append lora blocks in target module

* Support HunYuanDiT v1.1 and v1.2 lora

---------

Co-authored-by: leoriojhli <[email protected]>
    @xljh0520
    xljh0520 and leoriojhli committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    ee724d3 View commit details
    Browse the repository at this point in the history

  3. Add extra cond for Hunyuan_train_network (#7) 

    * add use_extra_cond for hy_train_network

* change model version

* Update hunyuan_train_network.py
    @sdbds
    sdbds committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    b69cc54 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Final change (#9) 

    * add use_extra_cond for hy_train_network

* change model version

* Update hunyuan_train_network.py

* Update hunyuan_train_network.py

* Update hunyuan_train.py
    @sdbds
    sdbds committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    0dc79ed View commit details
    Browse the repository at this point in the history