Skip to content

perf(optim): overlap the offloaded AdamW step with the next forward (builds on #4008) - #4427

Open
faresobeid wants to merge 15 commits into
mainfrom
perf/opt-offload-v2
Open

faresobeid wants to merge 15 commits into
mainfrom
perf/opt-offload-v2