Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Black space where face should be #25

Open
pr1ntr opened this issue Feb 17, 2024 · 11 comments
Open

Black space where face should be #25

pr1ntr opened this issue Feb 17, 2024 · 11 comments

Comments

@pr1ntr
Copy link

pr1ntr commented Feb 17, 2024

So this is what I get. I remember having this issue with automaticwebui something to do with xformers.. i don't remember now though. Any ideas?

image

@pr1ntr
Copy link
Author

pr1ntr commented Feb 17, 2024

if i set --windows-standalone-build --fp32-vae
image

--windows-standalone-build --fp32-vae --disable-cuda-malloc
image

@nosiu
Copy link
Owner

nosiu commented Feb 17, 2024

It hasn't been tested with turbo models
You are using LCM Lora and turbo model which is a very bad combo.
Also, you are resizing the face to 1024px, so it will try to generate something quite big 1024x~512 (guessing based on the aspect ratio of the mask), and turbo models usually can generate images no larger than 512x512

@anyshu
Copy link

anyshu commented Feb 18, 2024

same issue. black mask cannot be removed.

@pr1ntr
Copy link
Author

pr1ntr commented Feb 19, 2024

i did figure out the black mask thing ended up with these flags --fp32-vae --disable-cuda-malloc
for the bad quality it became pretty clear what the issue was @nosiu, wrong model and i think my workflow got messed up because once i reloaded with the LCM Lora it was good.

@claireliu14
Copy link

I got same problem ..
My comfyui is a version that supports CUDA121, but when executing instantid-faceswap, it will ask to use cuda 11, so I tried to install cuda 11.8 toolkit, but not used (If I change to cuda 11.8, comfyui while get error in ksampler). Could it be related to this?
Screenshot 2024-02-21 at 11 06 34 AM

@nosiu
Copy link
Owner

nosiu commented Feb 21, 2024

@claireliu14 try to run comfy with --fp32-vae argument, Console should say

VAE dtype: torch.float32

@deepfree2023
Copy link

deepfree2023 commented Feb 23, 2024

Tested several models, all normal models without lcm,turbo, dpo, etc., some worked well, some only produced black mask in the final result but the preview image was correct. Don't know why... with lcm lora enabled or not didn't affect the result.

@matabear-wyx
Copy link

matabear-wyx commented Feb 23, 2024

Tested several models, all normal models without lcm,turbo, dpo, etc., some worked well, some only produced black mask in the final result but the preview image was correct. Don't know why... with lcm lora enabled or not didn't affect the result.

@deepfree2023 Could u please share the models that worked well?

@deepfree2023
Copy link

Tested several models, all normal models without lcm,turbo, dpo, etc., some worked well, some only produced black mask in the final result but the preview image was correct. Don't know why... with lcm lora enabled or not didn't affect the result.

@deepfree2023 Could u please share the models that worked well?

Sure, realvisXLV40, animaPencilXL_v150, albedoBaseXL_v21, dynavisionXL

@liyunfei54
Copy link

测试了几个型号,都是没有lcm、turbo、dpo等的普通型号,有些效果很好,有些在最终结果中只产生了黑色蒙版,但预览图像是正确的。不知道为什么...... lcm lora 启用与否并没有影响结果。

@deepfree2023您能分享一下效果很好的模型吗?

当然,realvisXLV40、animaPencilXL_v150、albedoBaseXL_v21、dynavisionXL

thanks

@longmans
Copy link

It seems not stable, it crashs sometimes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants