Skip to content

[GDN, Attention] Make a mixed decode + prompt step cheaper - #965

Merged
NSagan271 merged 14 commits into
mainfrom
gdn-mixed-decode-width
Oct 30, 2026
Merged

NSagan271 merged 14 commits into
mainfrom
gdn-mixed-decode-width

Fetch the engine for split-row ordering only on mixed steps

dd1509a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
label
succeeded Oct 30, 2026 in 11s