Repository navigation

perf(optim): opt-in FP32 GPU gradient accumulation for full offload - #4221

Open

faresobeid wants to merge 17 commits into

mainfrom

fnsync-gpu-grad-accum

Open

perf(optim): opt-in FP32 GPU gradient accumulation for full offload#4221
faresobeid wants to merge 17 commits into
mainfrom
fnsync-gpu-grad-accum

Commits on Oct 10, 2026
- perf(optim): overlap optimizer state offload copies with the AdamW step
  faresobeid
  committed
  4309f95
Commits on Oct 11, 2026
- fix(optim): step parameters that have no offloaded state yet through the full path
  faresobeid
  committed
  37cba28
Commits on Oct 12, 2026
- refactor(optim): drop the always-true pin_memory and closure clauses of the chunked-step gate
  faresobeid
  committed
  9fc3f89
Commits on Oct 22, 2026
- perf(optim): opt-in FP32 GPU gradient accumulation for full offload
  faresobeid
  committed
  d300586
Commits on Oct 24, 2026
- Merge remote-tracking branch 'origin/main' into perf/optim-offload-overlap
  faresobeid
  committed
  e284620
Commits on Oct 26, 2026
- Merge remote-tracking branch 'origin/main' into b4008
  faresobeid
  committed
  50c0473
- Merge remote-tracking branch 'origin/main' into b4221
  faresobeid
  committed
  bdbfe38
Commits on Oct 28, 2026
- Merge remote-tracking branch 'origin/main' into r6-4221
  faresobeid
  committed
  669af74
- Merge remote-tracking branch 'origin/main' into r6-4008
  faresobeid
  committed
  cc5b2e6
- Merge remote-tracking branch 'origin/main' into r8-4221
  faresobeid
  committed
  afbbefc
- Merge remote-tracking branch 'origin/main' into r8-4008
  faresobeid
  committed
  0d7ba24
Commits on Oct 30, 2026
- Merge remote-tracking branch origin/main into perf/optim-offload-overlap
  faresobeid
  committed
  a4415c8
Commits on Nov 8, 2026