Upstream Sync#45

Merged

LucasWilkinson merged 33 commits intomainfrom

lwilkinson/upstream-sync-2

Feb 11, 2025

Commits on Jan 18, 2025

Support ROCM builds from source distribution, and improve error handling (#1446)
mgorny
authored

Commits on Jan 30, 2025

Commits on Feb 3, 2025

Implement HeadDim_V != HeadDim_QK, support hdimQK=192, hdimV=128
tridao
committed

Commits on Feb 7, 2025

Rename Mma0->MmaQK, Mma1->MmaPV, use Cluster only if hdimV >= 192
tridao
committed

Commits on Feb 10, 2025

Adjust ninja build file
tridao
committed

Commits on Feb 11, 2025