test for moe activation vram leak #3649

NanoCode012 merged 6 commits into

axolotl-ai-cloud:mainaxolotl-ai-cloud/axolotl:mainfrom

ved1beta:gemma_vram_leakved1beta/axolotl:gemma_vram_leakCopy head branch name to clipboard