Skip to content

[LoRA] Support LoRA under DP attention: idle-forward guards, attn-TP-local slicing, per-rank tensor serialization - #31520

Closed
yushengsu-thu wants to merge 6 commits into
mainfrom
yusheng/lora-dp-attention
Closed

[LoRA] Support LoRA under DP attention: idle-forward guards, attn-TP-local slicing, per-rank tensor serialization#31520
yushengsu-thu wants to merge 6 commits into
mainfrom
yusheng/lora-dp-attention

[LoRA] Update _FakeDenseLayer to the sliced-by-base-layer signature

382d020
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar