Attention Sinks Perf Boost#78

Merged

LucasWilkinson merged 25 commits intomainfrom

lwilkinson/aux-fast-api-clean

Aug 9, 2025

Commits on Aug 8, 2025

add sink test to attention_ref

jayhshah
authored and
LucasWilkinson
committed
embed sink test into main flash attn test script

jayhshah
authored and
LucasWilkinson
committed
change local block positioning for fast path

jayhshah
authored and
LucasWilkinson
committed
add tma gqa modifications

jayhshah
authored and
LucasWilkinson
committed
fix exploding build

jayhshah
authored and
LucasWilkinson
committed
try to fix exploding build again

jayhshah
authored and
LucasWilkinson
committed
prune other hdims to keep build stable

jayhshah
authored and
LucasWilkinson
committed
tweak tile size for causal not local case

jayhshah
authored and
LucasWilkinson
committed
split compilation

jayhshah
authored and
LucasWilkinson
committed
fix error with varlen q

jayhshah
authored and
LucasWilkinson
committed
split compilation for root setup

jayhshah
authored and
LucasWilkinson
committed
renable use one mma wg

jayhshah
authored and
LucasWilkinson
committed
update for hdim diff

jayhshah
authored and
LucasWilkinson
committed
include comments on how to enable hdim diff in cmakelists

jayhshah
authored and
LucasWilkinson
committed
fix test variable

jayhshah
authored and
LucasWilkinson
committed
update pack gqa heuristic

jayhshah
authored and
LucasWilkinson
committed
fix comment

jayhshah
authored and
LucasWilkinson
committed
split disable hdim diff macro into 64 and 192, enable 192 by default in cmakelists

jayhshah
authored and
LucasWilkinson
committed
add assert to check using Hopper kernels with s_aux

jayhshah
authored and
LucasWilkinson
committed
more logical placement of assert checks for hdim diff in flash api

jayhshah
authored and
LucasWilkinson
committed
cherrypick
LucasWilkinson
committed
typo fix
LucasWilkinson
committed
review comments
LucasWilkinson
committed
review comment
LucasWilkinson
committed

Commits on Aug 9, 2025

Merge remote-tracking branch 'upstream/main' into lwilkinson/aux-fast-api-clean
LucasWilkinson
committed