ggml : bump version to 0.23.0

[ggerganov]

Overview

Version 0.23.0 adds new operators and backend scheduling APIs for sparse attention, asynchronous execution, and allocation-dependency tracking. It includes broad correctness and performance work across CPU, GPU, and accelerator backends, plus an expanded RPC stack with Apple RDMA support.

API changes

• Added GGML_GLU_OP_SWIGLU_CLAMP and ggml_swiglu_clamp() (llama/27930).
• Added ggml_flash_attn_ext_set_n_kv_max() for sparse K/V masks (llama/27970).
• RPC protocol bumped to 6.0.0 for event/async APIs (llama/18626).

Core changes

• Added SWIGLU_CLAMP and sparse-attention n_kv_max support (llama/27930, llama/27970).
• Added allocation-size expansion tracking and allocation-dependency support in backend graph optimization (llama/27960, llama/27301).
• Fixed multi-batch conv_transpose_2d and allowed SET_ROWS in backward passes (llama/26132).
• Backend search-path enumeration tolerates filesystem errors; meta buffers propagate usage (llama/28271, llama/27586).
• Replaced compile-definition versioning with generated ggml-version.h (llama/28364).
• RPC gains event/async APIs, Apple RDMA transport, and avoids serializing remote buffers (llama/18626, llama/26421, llama/26500).

Backend changes

CPU

• AVX2 IQ prompt speedups for large batches (llama/27402).
• Fixed s390x Q5_1 uninitialized accumulator and added conditional SpacemiT IME kernels (llama/28332, llama/27961).
• Reworked KleidiAI build/integration and avoided buffer-type init on dispatch (llama/26077, llama/27891).

CUDA / ROCm

• Added sparse FA, XOR-swizzled FA K/V smem, radix top-k, and extended MoE fusions (llama/27970, llama/25635, llama/27466, llama/25952).
• Added concurrent streams per split, MMQ/MMVQ tunings, and MoE MMQ fixes (llama/28198, llama/28285, llama/26264).
• ROCm/hip: tuned RDNA3 MMQ configs and optimized Q2_0 dot products (llama/26284, llama/26753).

Metal

• Added sparse FA, radix top-k, quantized concat, and chunked SSD MMA (llama/28098, llama/28073, llama/28116, llama/26647).
• Added fa-vec tunings across many Apple GPUs and Metal 4.0 tensor API support (llama/28373, llama/27461).
• Added metallib xcframework support and fixed memory, leak, and dispatch issues (llama/28163, llama/27758, llama/28306).

Vulkan

• Added cross-entropy loss, radix top-k, Lightning Indexer op, and IQ3_S batch mat-vec improvements (llama/27216, llama/28032, llama/27453, llama/27449).
• Fixed FA dequant, mul_mat_id padding, view-alias deps, and warp-size handling (llama/28190, llama/27925, llama/27812, llama/27726).
• Added shader hoisting for row IDs/expert counts and bfloat16 extension gating (llama/26686, llama/28155).

SYCL

• Added residual fusions, peer-to-peer copy, and host-pinned memory limits (llama/27610, llama/27550, llama/27559).
• Added GPU free-memory query, split TOP_K long rows, TILE quantized KV decode, and oneDNN SDPA f16 KV binding (llama/27968, llama/27847, llama/26689, llama/27468).
• Reduced redundant Q4_K MMVQ work and improved --fit handling (llama/27062, llama/27629).

OpenCL

• Added quantized lm_head/decode GEMV and medium-batch GEMM optimizations (llama/26477).
• Added Adreno fixes and matmul path improvements, Intel Xe-LP quant tuning, and MoE binary kernels (llama/27640, llama/26438, llama/27768).

Hexagon

• Added F16 unary ops, ABS/LOG, MUL_MAT/MUL_MAT_ID fusion, and CPY fence fixes (llama/28228, llama/27786, llama/28202, llama/28033).
• Added multi-NPU device support, fully async backend, and on-demand device discovery (llama/26501, llama/27785).

OpenVINO

• Updated OpenVINO, added new op support, whisper.cpp support, and a fuse-to-conv pass (llama/27843).

RPC

• Implemented event and async backend APIs and Apple RDMA transport (llama/18626, llama/26421).
• Avoided serializing remote buffers and fixed pre-RDMA macOS teardown/version issues (llama/26500, llama/27815, llama/27908).

WebGPU

• Fixed misaligned offset crash in tensor get and marked MUL_MAT for allocation expansion (llama/28045, llama/28071).