feat(peft): support multi-LoRA on grouped MoE expert linears - #5155

Merged

yaoyu-33 merged 10 commits into

NVIDIA-NeMo:mainfrom

radixark:yusheng/multilora-moe-experts

Jul 29, 2026

Commits on Jun 8, 2026

[feat] add multi lora
mathewjhan
committed
0de06a8
[test] add multi lora tests
mathewjhan
committed
96a8152
[test] split tests + export tests
mathewjhan
committed
5e1f4b4

Commits on Jul 14, 2026

Merge branch 'main' into feat/upstream-multilora
mathewjhan
committed
309ab10
[chore] cherry pick from radixark branch
mathewjhan
committed
4c14d7d
[misc] pass all lora params
mathewjhan
committed
bebdfab
[misc] use register buffer
mathewjhan
committed
65d8c71
[fix] sharded state dict
mathewjhan
committed
c6b77b4

Commits on Jul 28, 2026

feat(peft): support multi-LoRA on grouped MoE expert linears
yushengsu-thu
committed
5fde419

Commits on Jul 29, 2026

Merge remote-tracking branch 'origin/main' into m5155
yaoyu-33
committed
1424e63