Repository navigation

perf(optim): overlap optimizer state offload copies with the AdamW step - #4008

Open

faresobeid wants to merge 11 commits into

mainfrom

perf/optim-offload-overlap

Open

perf(optim): overlap optimizer state offload copies with the AdamW step#4008
faresobeid wants to merge 11 commits into
mainfrom
perf/optim-offload-overlap

Commits on Oct 10, 2026
- perf(optim): overlap optimizer state offload copies with the AdamW step
  faresobeid
  committed
  4309f95
Commits on Oct 11, 2026
- fix(optim): step parameters that have no offloaded state yet through the full path
  faresobeid
  committed
  37cba28
Commits on Oct 12, 2026
- refactor(optim): drop the always-true pin_memory and closure clauses of the chunked-step gate
  faresobeid
  committed
  9fc3f89
Commits on Oct 24, 2026
- Merge remote-tracking branch 'origin/main' into perf/optim-offload-overlap
  faresobeid
  committed
  e284620
Commits on Oct 26, 2026
- Merge remote-tracking branch 'origin/main' into b4008
  faresobeid
  committed
  50c0473
Commits on Oct 28, 2026
- Merge remote-tracking branch 'origin/main' into r6-4008
  faresobeid
  committed
  cc5b2e6
- Merge remote-tracking branch 'origin/main' into r8-4008
  faresobeid
  committed
  0d7ba24
Commits on Oct 30, 2026
- Merge remote-tracking branch origin/main into perf/optim-offload-overlap
  faresobeid
  committed
  a4415c8
Commits on Nov 8, 2026
- Merge remote-tracking branch 'origin/main' into perf/optim-offload-overlap
  faresobeid
  committed
  1a8052f
Commits on Nov 10, 2026
- Merge remote-tracking branch 'origin/main' into perf/optim-offload-overlap
  
  faresobeid
  and
  claude
  committed
  0882a89
- test(optim): one parameter per offload chunk in the parity tests; reuse the DTensor local helpers in _move_states
  
  faresobeid
  and
  claude
  committed
  bfb7dc4