Repository navigation

[Perf] [MI355X] glm53: FP8 mid hand-off, early split rows, per-row up/gate jobs, NextN entry in four parts, TP4 at 8 rows (preview) - #21

Closed

heslami wants to merge 5 commits into

review/feat-glm53-nextn-draftsfrom

review/perf-glm53-shared-moe-nextn

Closed

[Perf] [MI355X] glm53: FP8 mid hand-off, early split rows, per-row up/gate jobs, NextN entry in four parts, TP4 at 8 rows (preview)#21
heslami wants to merge 5 commits into
review/feat-glm53-nextn-draftsfrom
review/perf-glm53-shared-moe-nextn

Commits on Oct 28, 2026
- glm53: Quantize each mid block to FP8 once, for every down task to read
  Hassan Eslami
  committed
  494f579
- glm53: Above 4 rows load the split tiles' KV cache rows ahead of q_b and uk
  Hassan Eslami
  committed
  69b544b
- glm53: At 4 rows run one row's up/gate jobs a CTA, the first after that row's first picks
  Hassan Eslami
  committed
  9cc3392
- glm53: Run the NextN entry in four K parts, past the index projection tiles
  Hassan Eslami
  committed
  1d5e48d
- glm53: Run steps of up to 8 rows on the kernels at TP4, as at TP8
  Hassan Eslami
  committed
  0b8b657