feature: Mixlora addition#3535

Open

OnePunchMonk wants to merge 6 commits into

axolotl-ai-cloud:mainfrom

OnePunchMonk:mixlora

Commits on Mar 22, 2026

feat: Add MixLoRA integration for MoE-style LoRA finetuning of dense models, including router, experts, FFN patching, and related schemas.
OnePunchMonk
committed
fix: address all MixLoRA review issues (#1-#13)
OnePunchMonk
committed
fix: address CodeRabbit review comments on PR #3535
OnePunchMonk
committed

Commits on Mar 24, 2026

feat: implement MixLoRA integration with custom trainer and plugin support
OnePunchMonk
committed

Commits on Mar 25, 2026

feat: enhance MixLoRA integration with new constants, improved training, and validation checks
OnePunchMonk
committed

Commits on Mar 29, 2026

resolve coderabbit comments
OnePunchMonk
committed