Repository navigation

feat(sft): pad to a multiple of cp and remove fp8 indexer dynamism - #3948

Merged

garrett361 merged 23 commits into

mainfrom

feat/sft-pad-to-cp-multiple

Oct 8, 2026

Merged

feat(sft): pad to a multiple of cp and remove fp8 indexer dynamism#3948
garrett361 merged 23 commits into
mainfrom
feat/sft-pad-to-cp-multiple

Commits on Oct 8, 2026
- feat(sft): pad packed rows only to a multiple of cp
  
  garrett361
  and
  claude
  committed
  51d169b
- chore(bench): add the SFT pad-to-cp harness and indexer autotune results
  
  garrett361
  and
  claude
  committed
  8c5b604
- fix(models): bucket S_Q in the fp8_indexer autotune key
  
  garrett361
  and
  claude
  committed
  4fb6b9b
- chore(bench): fix run_arm.sh quoting, add bucketed-key indexer results
  
  garrett361
  and
  claude
  committed
  e20f536
- chore(bench): vendor the scaleswe tool-call fix as data.patch, add compare.py
  
  garrett361
  and
  claude
  committed
  84ba91a
- chore(bench): add own-token padding patch (#3932) and the GLM-4.5-Air config
  
  garrett361
  and
  claude
  committed
  de01dd9
- chore(bench): add the 4-node attached launcher
  
  garrett361
  and
  claude
  committed
  d13b783
- chore(bench): isolate the TileLang cache per run
  
  garrett361
  and
  claude
  committed
  d2e0934
- chore(bench): report steady-state token counts in compare.py
  
  garrett361
  and
  claude
  committed
  27fd709
- perf(models): run fp8_indexer with one fixed config on 16-aligned keys
  
  garrett361
  and
  claude
  committed
  7260ecb
- chore(bench): add the fixed-config indexer study (grid, tuning cost, full-op validation)
  
  garrett361
  and
  claude
  committed
  45c18d9
- chore(bench): tolerate the indexer kernel without an autotuner in diag.patch
  
  garrett361
  and
  claude
  committed
  8c35cd3
- chore(bench): restore the executable bit on the run scripts
  
  garrett361
  and
  claude
  committed
  8e15183
- docs(orchestrator): describe pad_micro_batch's pad_to_multiple_of argument
  
  garrett361
  and
  claude
  committed
  d6c34f2
- fix(trainer): count the tokens each RL rank trained on, as SFT does
  
  garrett361
  and
  claude
  committed
  6c791a3
- chore(trainer): shorten the token-count comment in RL and SFT
  
  garrett361
  and
  claude
  committed
  e03efe2
- refactor(trainer): sum step tokens over the dp mesh instead of dividing out cp
  
  garrett361
  and
  claude
  committed
  a1a60e8
- chore(bench): sort imports in the indexer study scripts
  
  garrett361
  and
  claude
  committed
  1aacf64
- docs: revert the data.seq_len row change
  
  garrett361
  and
  claude
  committed
  8240f0c
- chore(trainer): note the token-count all-reduce on the dp mesh
  
  garrett361
  and
  claude
  committed
  20c6c33
- refactor(trainer): drop the SFT seq_len % (2 * cp) startup check
  
  garrett361
  and
  claude
  committed
  0ed0e78
- chore(bench): remove the SFT pad-to-cp harness
  
  garrett361
  and
  claude
  committed
  ca7c75b
- refactor(models): name the fp8_indexer key alignment
  
  garrett361
  and
  claude
  committed
  22f4285

Commits

Commits on Oct 8, 2026