Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regional Lora Hooks don't work on Flux/Quantized flux versions #497

Open
Matheus-Torres-Tavares opened this issue Nov 11, 2024 · 1 comment · May be fixed by #498
Open

Regional Lora Hooks don't work on Flux/Quantized flux versions #497

Matheus-Torres-Tavares opened this issue Nov 11, 2024 · 1 comment · May be fixed by #498

Comments

@Matheus-Torres-Tavares
Copy link

Any chance of this being supported in the future? The regional Lora hooks are a game changer and one of the best features of this pack.
For more context:

Anytime I run GGUF fp8 flux I get the following errors:

ERROR lora diffusion_model.double_blocks.9.img_attn.qkv.weight shape '[3072, 3264]' is invalid for input of size 9437184
ERROR lora diffusion_model.double_blocks.9.img_attn.qkv.weight shape '[3072, 3264]' is invalid for input of size 9437184
ERROR lora diffusion_model.double_blocks.9.img_attn.qkv.weight shape '[3072, 3264]' is invalid for input of size 9437184
ERROR lora diffusion_model.double_blocks.9.txt_attn.qkv.weight shape '[3072, 3264]' is invalid for input of size 9437184
ERROR lora diffusion_model.double_blocks.9.txt_attn.qkv.weight shape '[3072, 3264]' is invalid for input of size 9437184
ERROR lora diffusion_model.double_blocks.9.txt_attn.qkv.weight shape '[3072, 3264]' is invalid for input of size 9437184
ERROR lora diffusion_model.double_blocks.9.img_attn.proj.weight The size of tensor a (3264) must match the size of tensor b (3072) at non-singleton dimension 1
ERROR lora diffusion_model.double_blocks.9.img_mod.lin.weight The size of tensor a (3264) must match the size of tensor b (3072) at non-singleton dimension 1
ERROR lora diffusion_model.double_blocks.9.txt_mod.lin.weight The size of tensor a (3264) must match the size of tensor b (3072) at non-singleton dimension 1
ERROR lora diffusion_model.double_blocks.9.txt_attn.proj.weight The size of tensor a (3264) must match the size of tensor b (3072) at non-singleton dimension 1
ERROR lora diffusion_model.double_blocks.9.img_mlp.0.weight The size of tensor a (3264) must match the size of tensor b (3072) at non-singleton dimension 1
ERROR lora diffusion_model.double_blocks.9.img_mlp.2.weight The size of tensor a (13056) must match the size of tensor b (12288) at non-singleton dimension 1
ERROR lora diffusion_model.double_blocks.9.txt_mlp.0.weight The size of tensor a (3264) must match the size of tensor b (3072) at non-singleton dimension 1
ERROR lora diffusion_model.double_blocks.9.txt_mlp.2.weight The size of tensor a (13056) must match the size of tensor b (12288) at non-singleton dimension 1

If I run flux dev the workflow runs but doesn't apply any of the regional Loras.

@Kosinkadink
Copy link
Owner

This should be fixed when my hooks become a native feature in my ComfyUI PR, currently estimated to get merged around Thanksgiving: comfyanonymous/ComfyUI#5583

My corresponding ADE PR will make use of these hooks in the existing nodes, and also deprecate them in favor of the new native nodes. #498

@Kosinkadink Kosinkadink linked a pull request Nov 26, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants