Skip to content

perf(optim): overlap the offloaded AdamW step with the next forward (builds on #4008) - #4427

Open
faresobeid wants to merge 15 commits into
mainfrom
perf/opt-offload-v2
Open

perf(optim): overlap the offloaded AdamW step with the next forward (builds on #4008)#4427
faresobeid wants to merge 15 commits into
mainfrom
perf/opt-offload-v2

Commits

  1. Commits on Oct 10, 2026

  2. Commits on Oct 11, 2026

  3. Commits on Oct 12, 2026

  4. Commits on Oct 24, 2026

  5. Commits on Oct 26, 2026

  6. Commits on Oct 28, 2026

  7. Commits on Oct 30, 2026

  8. Commits on Nov 8, 2026

  9. Commits on Nov 10, 2026