Skip to content

Conversation

@tolgacangoz
Copy link
Contributor

@tolgacangoz tolgacangoz commented Mar 9, 2024

Fixes #7064 for StableDiffusionPanoramaPipeline.
It looks like most of the work has already been done. StableDiffusionPanoramaPipeline class seems to pass the tests of IPAdapterTesterMixin in my local setup.

Thanks for this opportunity!
@yiyixuxu

@tolgacangoz tolgacangoz changed the title [IP-Adapter] Add properties and IPAdapterTesterMixin tests for StableDiffusionPanoramaPipeline [IP-Adapter] Fix IP Adapter Support for Panorama Pipeline Mar 9, 2024
@tolgacangoz tolgacangoz changed the title [IP-Adapter] Fix IP Adapter Support for Panorama Pipeline [IP-Adapter] Fix IP-Adapter Support for Panorama Pipeline Mar 9, 2024
Copy link
Collaborator

@yiyixuxu yiyixuxu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh thanks!
we also need to dd the callback_on_step_end like how it's done here #7149

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@tolgacangoz
Copy link
Contributor Author

tolgacangoz commented Mar 11, 2024

StableDiffusionPanoramaPipeline class passes the tests of IPAdapterTesterMixin when I set ..., device="cuda").to(torch_device) here. But when device="cpu" as expected for fast CPU tests, it cannot pass. I am currently working on this.

@tolgacangoz
Copy link
Contributor Author

tolgacangoz commented Mar 11, 2024

The last commit seems to resolve the issue. Now, I am working on adding callback_on_step_end.

@tolgacangoz tolgacangoz requested a review from yiyixuxu March 12, 2024 10:16
@tolgacangoz tolgacangoz changed the title [IP-Adapter] Fix IP-Adapter Support for Panorama Pipeline [IP-Adapter] Fix IP-Adapter Support and Refactor 📞🔙 for Panorama Pipeline Mar 12, 2024
@tolgacangoz tolgacangoz changed the title [IP-Adapter] Fix IP-Adapter Support and Refactor 📞🔙 for Panorama Pipeline [IP-Adapter] Fix IP-Adapter Support and Refactor Callback for Panorama Pipeline Mar 12, 2024
@tolgacangoz tolgacangoz changed the title [IP-Adapter] Fix IP-Adapter Support and Refactor Callback for Panorama Pipeline [IP-Adapter] Fix IP-Adapter Support and Refactor Callback for StableDiffusionPanoramaPipeline Mar 15, 2024
@tolgacangoz
Copy link
Contributor Author

@yiyixuxu Here is ready for a review.

@yiyixuxu
Copy link
Collaborator

can you make sure the quality tests pass?

@tolgacangoz
Copy link
Contributor Author

Done!

@tolgacangoz
Copy link
Contributor Author

tolgacangoz commented Mar 22, 2024

There were 2 errors. One went away when I merged with the main branch and the other seems irrelevant to me in terms of this PR.

FAILED tests/pipelines/test_pipelines.py::CustomPipelineTests::test_remote_components
- ImportError: cannot import name 'PositionNet' from 'diffusers.models.embeddings'
(/__w/diffusers/diffusers/src/diffusers/models/embeddings.py)

@yiyixuxu yiyixuxu merged commit f7dfcfd into huggingface:main Mar 25, 2024
@tolgacangoz
Copy link
Contributor Author

Thanks for merging!

@tolgacangoz tolgacangoz deleted the fix-ipadapter-StableDiffusionPanoramaPipeline branch March 25, 2024 06:09
AbhinavGopal pushed a commit to AbhinavGopal/diffusers that referenced this pull request Mar 27, 2024
…leDiffusionPanoramaPipeline` (huggingface#7262)

* Add properties and `IPAdapterTesterMixin` tests for `StableDiffusionPanoramaPipeline`

* Update torch manual seed to use `torch.Generator(device=device)`

* Refactor 📞🔙 to support `callback_on_step_end`

* make fix-copies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ip-adapter]fix IP-adapter support for SAG, panorama pipeline

3 participants