Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support ProMax union model #2998

Merged
merged 2 commits into from
Jul 15, 2024
Merged

Support ProMax union model #2998

merged 2 commits into from
Jul 15, 2024

Conversation

huchenlei
Copy link
Collaborator

The promax union model supports 2 new control types: Tile and Inpaint. You can download the model here: https://huggingface.co/xinsir/controlnet-union-sdxl-1.0/tree/main

Tile

image
image

1girl, hatsune miku,, absurdres, highres, (masterpiece:1.2), (best quality, highest quality),
Negative prompt: (lowres, low quality, worst quality:1.2), (text:1.2), watermark, (frame:1.2), deformed, ugly, deformed eyes, blur, out of focus, blurry, deformed cat, deformed, photo, anthropomorphic cat, monochrome, photo, pet collar, gun, weapon, blue, 3d, drones, drone, buildings in background, green
Steps: 30, Sampler: DPM++ 2M, Schedule type: Karras, CFG scale: 7, Seed: 3582562933, Size: 768x1024, Model hash: 5a268fde84, Model: netaArtXL_v10, Clip skip: 2, ControlNet 0: "Module: blur_gaussian, Model: controlnet++_union_promax_sdxl [9460e4db], Weight: 1.0, Resize Mode: Crop and Resize, Processor Res: 512, Threshold A: 9.0, Threshold B: 0.5, Guidance Start: 0.0, Guidance End: 1.0, Pixel Perfect: False, Control Mode: Balanced", Version: v1.9.4-253-gb2453d28

image
image

absurdres, highres, (masterpiece:1.2), (best quality, highest quality),
Negative prompt: (lowres, low quality, worst quality:1.2), (text:1.2), watermark, (frame:1.2), deformed, ugly, deformed eyes, blur, out of focus, blurry, deformed cat, deformed, photo, anthropomorphic cat, monochrome, photo, pet collar, gun, weapon, blue, 3d, drones, drone, buildings in background, green
Steps: 20, Sampler: DPM++ 2M, Schedule type: Karras, CFG scale: 7, Seed: 3086528334, Size: 768x1024, Model hash: 5a268fde84, Model: netaArtXL_v10, Clip skip: 2, ControlNet 0: "Module: blur_gaussian, Model: controlnet++_union_promax_sdxl [9460e4db], Weight: 1.0, Resize Mode: Crop and Resize, Processor Res: 512, Threshold A: 9.0, Threshold B: 0.5, Guidance Start: 0.0, Guidance End: 1.0, Pixel Perfect: False, Control Mode: Balanced", Version: v1.9.4-253-gb2453d28

Inpaint

Does not work right now. Need to wait author update inference script in https://github.com/xinsir6/ControlNetPlus/tree/main. It probably uses different protocol for inpaint comparing to the current impl in sd-webui-controlnet.

@huchenlei huchenlei merged commit 3ff69b9 into Mikubill:main Jul 15, 2024
2 checks passed
@huchenlei huchenlei deleted the promax branch July 15, 2024 01:17
@light-and-ray
Copy link

Inpaint: Does not work right now

I can get something. Just use "None" preprocessor + pixel perfect (to avoid blur) + image where black pixels mean mask. This comfy workflow do the same

00008-1835962484-a face of cat
ComfyUI_00008_

You can get masking workflow from metadata

But there is still a black contour, I think someone somewhere resizes it

@huchenlei

@light-and-ray
Copy link

Ah yes this:
Resize Mode
Just Resize
Crop and Resize
Resize and Fill

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants