Repository navigation

[Perf] [MI355X] glm53: K-split front, top-8 tie shortcut, router norm in its logits (preview) - #22

Closed

heslami wants to merge 3 commits into

review/perf-glm53-shared-moe-nextnfrom

review/perf-glm53-front-ksplit

Closed

[Perf] [MI355X] glm53: K-split front, top-8 tie shortcut, router norm in its logits (preview)#22
heslami wants to merge 3 commits into
review/perf-glm53-shared-moe-nextnfrom
review/perf-glm53-front-ksplit

Commits on Oct 28, 2026
- glm53: Split the front's K between a tile's CTA and a spare one, over every CTA
  Hassan Eslami
  committed
  927167d
- glm53: Reduce a top-8 round's expert ID only when its maximum is tied
  Hassan Eslami
  committed
  ee18730
- glm53: Multiply the router's row unnormalized and scale its logits by the rstd
  Hassan Eslami
  committed
  1aa8e48