feat: add support and end-to-end tests for multiple custom optimizers…#3457

Merged

winglian merged 9 commits into

axolotl-ai-cloud:mainfrom

OnePunchMonk:main

Mar 20, 2026

Commits on Mar 5, 2026

feat: add support and end-to-end tests for multiple custom optimizers including Optimi AdamW, ADOPT AdamW, Muon, Dion, Schedule-Free AdamW, CAME PyTorch, and Flash AdamW.
OnePunchMonk
committed
feat: Add standalone flashoptim integration test and E2E tests for various custom optimizers including FlashAdamW, FlashAdam, FlashSGD, FlashSGDW, FlashLion, optimi_adamw, adopt_adamw, muon, dion, …
OnePunchMonk
committed

Commits on Mar 7, 2026

Commits on Mar 8, 2026

Commits on Mar 11, 2026

fix: address PR review - reuse require_torch_2_7_0 decorator, remove fsdp_config.version check, extract shared FSDP version helper, remove unused imports and optim_args
OnePunchMonk
committed

Commits on Mar 20, 2026

chore: lint
NanoCode012
committed