Skip to content

[Diffusion] Add plain component weight overrides - #36086

Merged
mickqian merged 1 commit into
mainfrom
codex/diffusion-plain-component-weight-overrides
Aug 24, 2026
Merged

[Diffusion] Add plain component weight overrides#36086
mickqian merged 1 commit into
mainfrom
codex/diffusion-plain-component-weight-overrides

Conversation

@mickqian

@mickqian mickqian commented Aug 23, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add one shared weights-only resolver to native plain-state component loaders
  • let connectors, duration heads, diffusion decoders, sound tokenizers, and vocoders retain base config while replacing local or Hub weights
  • teach the shared safetensors utility to accept an exact file as well as a directory/sharded set
  • preserve existing strict state-dict admission and key validation

The spatial upsampler already accepts exact files and remains unchanged. The MOVA bridge is intentionally excluded because its non-FSDP path still delegates construction and loading together to from_pretrained.

Stacked on #36078.

Validation

  • pre-commit hooks
  • focused shared resolver contract

Churn against #36078: 66 additions, 19 deletions.


CI States

Latest PR Test (Base): ✅ Run #32683724088
Latest PR Test (Extra): ❌ Run #32683724127
Latest PR Test (AMD ROCm 7.2): ⏳ Run #32683724307

@github-actions github-actions Bot added quant LLM Quantization diffusion SGLang Diffusion labels Aug 23, 2026
Base automatically changed from codex/diffusion-component-weight-cli to main August 24, 2026 01:31
@mickqian
mickqian force-pushed the codex/diffusion-plain-component-weight-overrides branch from 1b54752 to 1d5091c Compare August 24, 2026 01:34
@mickqian
mickqian force-pushed the codex/diffusion-plain-component-weight-overrides branch from 1d5091c to 40da351 Compare August 24, 2026 02:38
@mickqian
mickqian merged commit 3fe18f1 into main Aug 24, 2026
168 of 180 checks passed
@mickqian
mickqian deleted the codex/diffusion-plain-component-weight-overrides branch August 24, 2026 05:33
longxin9715 added a commit to longxin9715/sglang that referenced this pull request Aug 24, 2026
…n-transport1

* 'main' of https://github.com/sgl-project/sglang: (326 commits)
  [diffusion] feat: cache LoRA-merged weights in files the page cache can hold (sgl-project#36062)
  [diffusion] Speed up LingBot high-quality VAE decode (sgl-project#36024)
  [diffusion] Honor XDG cache for model overlays (sgl-project#36019)
  Support streaming session on NPU (sgl-project#32597)
  fix(xpu): read enable_deterministic_inference from the config bag (sgl-project#36149)
  xeon ci fail fast strategy change (sgl-project#36146)
  [diffusion] Fix Hunyuan QKV pack indexing at production video shapes (sgl-project#36009)
  [diffusion] Refresh quality and BCG benchmark skills (sgl-project#36016)
  [MoE] Gather the cutlass MoE activation and its scales in one launch (sgl-project#34915)
  [diffusion] feat: add plain component weight overrides (sgl-project#36086)
  [diffusion] feat: support loading mixed w4a8 text encoders (sgl-project#36037)
  [diffusion] Default Hunyuan VAE to tiled decode (sgl-project#36012)
  fix(xpu): enable compressed-tensors FP8 W8A8 on XPU (RedHatAI FP8-dynamic models) (sgl-project#33057)
  chore: move cuda_vmm_utils.py under srt/utils/ (sgl-project#36053)
  [Intel XPU] Add xpu pass for biased_topk and hash_topk (sgl-project#33323)
  [CPU] Fix NUMA/core binding for DP ranks (sgl-project#32856)
  [Fix] Harden FlashAttention CUDA graph metadata bounds (sgl-project#35454)
  [XPU] Use a fused GDN kernel from sgl-kernel for Qwen3.5 (sgl-project#33354)
  [diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE (sgl-project#35995)
  [diffusion] Keep LongLive2 components resident on large GPUs (sgl-project#35993)
  ...

# Conflicts:
#	python/sglang/srt/multimodal/processors/base_processor.py
#	python/sglang/srt/server_args.py
saturn-acc pushed a commit to saturn-acc/sglang that referenced this pull request Aug 31, 2026
jakki-amd pushed a commit to jakki-amd/sglang that referenced this pull request Sep 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

diffusion SGLang Diffusion quant LLM Quantization run-ci

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant