Repository navigation

Enable static CPU offload for FP16/BF16 CUDA MoE - #33039

Closed

Xavier Dupré (xadupre) wants to merge 41 commits into

mainfrom

moe-fp16-static-cpu-offload

Closed

Enable static CPU offload for FP16/BF16 CUDA MoE#33039
Xavier Dupré (xadupre) wants to merge 41 commits into
mainfrom
moe-fp16-static-cpu-offload

Commits on Oct 1, 2026
- Enable static CPU offload for FP16 CUDA MoE
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  f587392
- Merge origin/main into moe-fp16-static-cpu-offload
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  94d0479
- Use CPU expert count for MoE offload
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  e224f2d
- Address static MoE offload review feedback
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  418f028
- Address static MoE offload review feedback
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  47ddc99
Commits on Oct 2, 2026
- Fix cross-platform MoE build errors
  
  Copilot
  and
  Xavier Dupré (xadupre)
  authored
  d4103d8
- Overlap MoE CPU input transfer with routing
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  6d293cd
- Fix MoE all-CPU offload preparation
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  75e917c
- Keep offloaded MoE initializers on CPU
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  ee7c675
- Address MoE offload review findings
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  61f587a
- Refine MoE CPU offload execution
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  a2c8d4b
- Test mixed MoE expert contributions
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  10b24f7
- Address final MoE offload review
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  9d97a2f
Commits on Oct 5, 2026
- Merge remote-tracking branch 'origin/main' into moe-fp16-static-cpu-offload
  Xavier Dupré (xadupre)
  committed
  6a9d27a
- Fix MoE CPU offload build and execution
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  59b5940
- Address remaining MoE offload review findings
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  61b8a25
- Fix MoE offload CI regressions
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  212c47c
- Handle legacy MoE weight layouts in CPU offload
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  f212726
- Fix ARM Python image dependency installation
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  02e7c69
- Address remaining MoE offload review concerns
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  4813edd
- Complete MoE offload retention, coverage and documentation fixes
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  9792f1a
- Cover all FP16 CPU offload activations and SwiGLU parameters
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  de41b65
- Fix mixed MoE offload input aliasing race
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  1ac39a6
- Test MoE CPU offload prepacking requirement
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  b4ef8fc
- Respect subgraph scope in MoE offload initializer validation
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  7bb43c5
- Scope MoE expert initializer collection to actual captures
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  66fc23b
- Test sparse mixer rejection with MoE CPU offload
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  6c57615
- Verify non-square MoE layouts against CUDA-only execution
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  56f08e8
Commits on Oct 7, 2026
- Add BF16 CUDA MoE CPU offload
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  b45f46e
- Exclude BF16 MoE bridge from minimal builds
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  46bbd97
- Address BF16 MoE offload review feedback
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  6553fd8
- Exclude MoE offload plumbing from minimal builds
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  951bede
- Remove MoE offload handling from minimal builds
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  2eb7d63
Commits on Oct 8, 2026
- Merge remote-tracking branch 'origin/main' into moe-fp16-static-cpu-offload
  
  Copilot
  and
  Xavier Dupré (xadupre)
  authored
  da0162a
Commits on Oct 9, 2026
- Fix MoE offload review regressions
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  2834ef3
- Fix MoE profiling branch selection
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  ef78678
- Keep minimal MoE validation compact
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  07bb1cd
- Fix CUDA MoE offload device handling
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  a805b04
Commits on Oct 12, 2026
- Simplify MoE expert counter decay
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  0f4eebc
- Fix alpha-only counter log expectation
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  c482daf
Commits on Oct 13, 2026
- Update MoE counters on CUDA and compact CPU offload work
  
  Xavier Dupré (xadupre)
  and
  Copilot
  committed
  f008ad4

Commits

Commits on Oct 1, 2026

Commits on Oct 2, 2026

Commits on Oct 5, 2026

Commits on Oct 7, 2026

Commits on Oct 8, 2026

Commits on Oct 9, 2026

Commits on Oct 12, 2026

Commits on Oct 13, 2026