[peft] Support multi-lora for Megatron models - #4218

Merged

yaoyu-33 merged 8 commits into

NVIDIA-NeMo:mainfrom

mathewjhan:feat/upstream-multilora

Jul 29, 2026

Commits on Jun 8, 2026

[feat] add multi lora
mathewjhan
committed
0de06a8
[test] add multi lora tests
mathewjhan
committed
96a8152
[test] split tests + export tests
mathewjhan
committed
5e1f4b4

Commits on Jul 14, 2026

Merge branch 'main' into feat/upstream-multilora
mathewjhan
committed
309ab10
[chore] cherry pick from radixark branch
mathewjhan
committed
4c14d7d
[misc] pass all lora params
mathewjhan
committed
bebdfab
[misc] use register buffer
mathewjhan
committed
65d8c71
[fix] sharded state dict
mathewjhan
committed
c6b77b4