Skip to content

[Diffusion][RL] Reuse disk LoRA mapping and FFN swap on H3 IPC updates - #37350

Merged
Zhichenzzz merged 3 commits into
sgl-project:sglang-miles-h3from
niehen6174:e2e/miles-h3-lora-ipc
Sep 9, 2026
Merged

Zhichenzzz merged 3 commits into
sgl-project:sglang-miles-h3from
niehen6174:e2e/miles-h3-lora-ipc

Conversation

@niehen6174

@niehen6174 niehen6174 commented Sep 1, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • LoRA IPC now reuses the same PEFT → native name mapping as disk --lora-path.
  • Apply the same H3 FFN lora_B swap ([value; gate] → [gate; value]) on IPC writes.
  • On miles-h3, resolve also probes the *.lora_A suffix the disk mapping already understands.
  • Other models are unchanged: the swap only matches PEFT ff.net.0.proj → native mlp.fc1.

Test plan

  • pytest python/sglang/multimodal_gen/test/unit/test_fused_lora_compose.py::test_h3_ipc_reuses_disk_mapping_and_ffn_swap

CI States

Latest PR Test (Base): ❌ Run #33472749295
Latest PR Test (Extra): ❌ Run #33472749167
Latest PR Test (AMD ROCm 7.2): ❌ Run #33472749258

Export swap_peft_swiglu_fc1_lora_b so IPC writes reuse the same
[value; gate] → [gate; value] rewrite as disk load_lora_adapter.
On miles-h3, resolve also probes the LoRA suffix the disk mapping
already understands.
@Zhichenzzz
Zhichenzzz merged commit 859a278 into sgl-project:sglang-miles-h3 Sep 9, 2026
81 of 90 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

diffusion SGLang Diffusion lora

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants