-
Notifications
You must be signed in to change notification settings - Fork 7.4k
Add modular pipeline for HunyuanVideo 1.5 #13389
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 18 commits
Commits
Show all changes
19 commits
Select commit
Hold shift + click to select a range
48b4f3f
Add modular pipeline support for HunyuanVideo 1.5
akshan-main f029fc5
Fix I2V latent/cond spatial dimension mismatch
akshan-main 5cc2ed1
Fix guidance_scale default to 7.5 matching ClassifierFreeGuidance
akshan-main db41b41
Fix tokenizer type: use Qwen2TokenizerFast to match model
akshan-main bfbb6b4
Fix system message string formatting to match standard pipeline
akshan-main aec5b38
Rewrite HunyuanVideo 1.5 modular: use standard pipeline methods directly
akshan-main d9ad0ef
Remove I2V exports (T2V only for now)
akshan-main 5923b5e
Fix encoder: use static methods directly instead of encode_prompt
akshan-main 1691e31
Inline all standard pipeline methods, remove runtime dependency
akshan-main d189ef1
Add HunyuanVideo 1.5 image-to-video modular blocks
akshan-main cfd5de4
Fix missing FrozenDict import in before_denoise.py
akshan-main acada9b
auto-generated docstrings via #auto_docstring
akshan-main 6ec688d
Fix ruff lint and format issues
akshan-main 93d0426
use InputParam/OutputParam templates and fix ruff
akshan-main 86fe24a
Address LTX review feedback here like add AutoBlocks, refactor I2V la…
akshan-main 77cd7d6
Add workflow map, workflow tests, auto docstrings, export only AutoBl…
akshan-main 458c97c
Merge branch 'main' into modular-hunyuan1.5
yiyixuxu da4f4ef
Address Claude CI review
akshan-main 2bfc708
Address claude CI review 2
akshan-main File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
55 changes: 55 additions & 0 deletions
55
src/diffusers/modular_pipelines/hunyuan_video1_5/__init__.py
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -0,0 +1,55 @@ | ||||||
| from typing import TYPE_CHECKING | ||||||
|
|
||||||
| from ...utils import ( | ||||||
| DIFFUSERS_SLOW_IMPORT, | ||||||
| OptionalDependencyNotAvailable, | ||||||
| _LazyModule, | ||||||
| get_objects_from_module, | ||||||
| is_torch_available, | ||||||
| is_transformers_available, | ||||||
| ) | ||||||
|
|
||||||
|
|
||||||
| _dummy_objects = {} | ||||||
| _import_structure = {} | ||||||
|
|
||||||
| try: | ||||||
| if not (is_transformers_available() and is_torch_available()): | ||||||
| raise OptionalDependencyNotAvailable() | ||||||
| except OptionalDependencyNotAvailable: | ||||||
| from ...utils import dummy_torch_and_transformers_objects # noqa F403 | ||||||
|
|
||||||
| _dummy_objects.update(get_objects_from_module(dummy_torch_and_transformers_objects)) | ||||||
| else: | ||||||
| _import_structure["modular_blocks_hunyuan_video1_5"] = [ | ||||||
| "HunyuanVideo15AutoBlocks", | ||||||
| "HunyuanVideo15Blocks", | ||||||
| "HunyuanVideo15Image2VideoBlocks", | ||||||
| ] | ||||||
| _import_structure["modular_pipeline"] = ["HunyuanVideo15ModularPipeline"] | ||||||
|
|
||||||
| if TYPE_CHECKING or DIFFUSERS_SLOW_IMPORT: | ||||||
| try: | ||||||
| if not (is_transformers_available() and is_torch_available()): | ||||||
| raise OptionalDependencyNotAvailable() | ||||||
| except OptionalDependencyNotAvailable: | ||||||
| from ...utils.dummy_torch_and_transformers_objects import * # noqa F403 | ||||||
| else: | ||||||
| from .modular_blocks_hunyuan_video1_5 import ( | ||||||
| HunyuanVideo15AutoBlocks, | ||||||
| HunyuanVideo15Blocks, | ||||||
| HunyuanVideo15Image2VideoBlocks, | ||||||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. done |
||||||
| ) | ||||||
| from .modular_pipeline import HunyuanVideo15ModularPipeline | ||||||
| else: | ||||||
| import sys | ||||||
|
|
||||||
| sys.modules[__name__] = _LazyModule( | ||||||
| __name__, | ||||||
| globals()["__file__"], | ||||||
| _import_structure, | ||||||
| module_spec=__spec__, | ||||||
| ) | ||||||
|
|
||||||
| for name, value in _dummy_objects.items(): | ||||||
| setattr(sys.modules[__name__], name, value) | ||||||
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.