Skip to content

Fix load of z-image-turbo - #9264

Merged
mudler merged 2 commits into
mudler:masterfrom
thelittlefireman:patch-1
Apr 11, 2026
Merged

Fix load of z-image-turbo#9264
mudler merged 2 commits into
mudler:masterfrom
thelittlefireman:patch-1

Conversation

@thelittlefireman

Copy link
Copy Markdown
Contributor

Description

This PR fixes error on load z-image-turbo

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

@mudler
mudler requested a review from richiejp April 7, 2026 13:02

@richiejp richiejp left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this! May have to drop the flash attention settings or else remove it when Intel is present.

Comment thread gallery/z-image-ggml.yaml Outdated
- llm_path:Qwen3-4B.Q4_K_M.gguf
- vae_path:ae.safetensors
- offload_params_to_cpu:true
- diffusion_flash_attn:true

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately this is broken on Intel SYCL. I'm not sure how we want to handle this @mudler ?

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would suggest to ignore the option in the backend and detect intel usage there

Comment thread gallery/z-image-ggml.yaml
- diffusion_flash_attn:true
parameters:
model: z_image_turbo-Q4_K.gguf
model: z_image_turbo-Q4_0.gguf

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks!

@thelittlefireman thelittlefireman changed the title Fix load of z-image and improve speed Fix load of z-image-turbo Apr 7, 2026
Signed-off-by: thelittlefireman <5165783+thelittlefireman@users.noreply.github.com>
Removed 'diffusion_flash_attn' parameter from configuration.

Signed-off-by: thelittlefireman <5165783+thelittlefireman@users.noreply.github.com>
@mudler
mudler merged commit 7c1865b into mudler:master Apr 11, 2026
30 of 32 checks passed
@mudler mudler added the bug Something isn't working label Apr 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants