Skip to content

[Perf] [MI355X] glm53: K-split front, top-8 tie shortcut, router norm in its logits (preview) - #22

Closed
heslami wants to merge 3 commits into
review/perf-glm53-shared-moe-nextnfrom
review/perf-glm53-front-ksplit
Closed

[Perf] [MI355X] glm53: K-split front, top-8 tie shortcut, router norm in its logits (preview)#22
heslami wants to merge 3 commits into
review/perf-glm53-shared-moe-nextnfrom
review/perf-glm53-front-ksplit

glm53: Multiply the router's row unnormalized and scale its logits by…

1aa8e48
Select commit
Loading
Failed to load commit list.

There are no checks for this commit