[Bugfix] Fix dropped diffusion executor backend in default config #2539#2544
[Bugfix] Fix dropped diffusion executor backend in default config #2539#2544reidliu41 wants to merge 2 commits intovllm-project:mainfrom
Conversation
- preserve distributed_executor_backend in default diffusion stage config - add regression tests for default stage creation and resolution Signed-off-by: reidliu41 <reid201711@gmail.com>
|
Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits. |
|
It looks like the issue might not be limited to this parameter — a few other engine args are also affected in the fallback path. I’ve tried to fix them in #2559. |
lishunyang12
left a comment
There was a problem hiding this comment.
Looks good. The fix is minimal and correctly follows the existing pattern established by dtype propagation.
A few observations:
-
Production code: The
Noneguard (and normalized_kwargs["distributed_executor_backend"] is not None) is the right call -- without it, an explicitNonewould override downstream defaults. Consistent with how other optional fields are handled. -
Tests: Both the unit test on
_create_default_diffusion_stage_cfgand the integration test throughload_and_resolve_stage_configsprovide good regression coverage. -
Minor note for future consideration (not blocking): This method is accumulating a growing list of one-off conditional propagations (dtype, now distributed_executor_backend). If more kwargs need the same treatment, it might be worth a small helper or a whitelist-driven loop. But that is outside the scope of this bugfix.
LGTM -- approve.
Signed-off-by: reidliu41 <reid201711@gmail.com>
PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.
Purpose
Fix #2539.
The default diffusion stage config builder dropped
distributed_executor_backend, sovllm serve --omni --distributed-executor-backend ...was not propagated to diffusion models that use the default fallback stage
config path.
This change preserves the explicitly provided backend in
AsyncOmniEngine._create_default_diffusion_stage_cfg, matching the existingexplicit propagation pattern used for
dtype.Value:
Test Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model. Please runmkdocs serveto sync the documentation editions to./docs.BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)