feat: TBQ4_0 + TBQ3_0 CUDA flash attention for SM121 (DGX Spark)#1

Open

mihai-chiorean wants to merge 112 commits into

release/turbo3-cudafrom

feat/tbq4-cuda-fa-sm121

Commits on Mar 28, 2026

Commits on Mar 30, 2026

Commits on Mar 31, 2026

Commits on Apr 1, 2026

ggml webgpu: quantized buffers to u32 + wider browser/device support (#21046)
reeselevine
authored
llama : refactor llama_model_quantize_params to expose a pure C interface (#20346)

EAddario
and
ggerganov
authored
CUDA: Add Flash Attention Support for Head Dimension 512 (#20998)

anavp-nvidia
and
JohannesGaessler
authored
ggml-cpu: fix fallback for RVV kernels without zvfh (#21157)
taimur-10x
authored
ggml : fix RWKV ops thread assignment (#21226)
ggerganov
authored
CUDA/HIP: Fix kernel slection for mmvq mmid kernel to align host selection with device launch bounds (#21238)
IMbackK
authored
memory: respect unified KV cache in hybrid memory for eval tasks (#21224)
mudler
authored
ggml-cuda: Add generic NVFP4 MMQ kernel (#21074)

michaelw9999
and
JohannesGaessler
authored
sycl : support nvfp4 type in mul_mat (#21227)
arthw
authored
ggml : bump version to 0.9.10 (ggml/1454)
ggerganov
committed
sync : ggml
ggerganov
committed
scripts: add function call test script (#21234)
ngxson
authored
llama : rotate activations for better quantization (#21038)
ggerganov
authored
fix: tool call parsing for LFM2 and LFM2.5 models (#21242)
jbuchananr
authored
hexagon: improve RMS_NORM and DIV accuracy (#21251)

aparmp-quic
and
srikris-sridhar
authored
Update Dawn version in WebGPU CI (#20784)
nikhilJain17
authored
kleidiai: add CPU feature detection to CI run script (#20394)
martin-klacer-arm
authored
perf: add norm correction + sparse V dequant from TheTom's turboquant_plus
mihai-chiorean
committed
CUDA: fix FA kernel selection logic (#21271)
JohannesGaessler
authored
server: Bypass API Key validation for WebUI static bundle assets (#21269)
allozaur
authored
opencl: fix leak in Adreno q8_0 path (#21212)
lhez
authored
contrib : rewrite AGENTS.md, make it more clear about project values (#21270)
ngxson
authored

Commits on Apr 2, 2026

Commits on Apr 3, 2026

Commits on Apr 4, 2026

refactor: remove TBQ rotation, use upstream Walsh-Hadamard (PR #21038)
mihai-chiorean
committed