Repository navigation

[MiniMax-M3.1] MXFP4 sparse KV cache and index cache - #2770

Open

ganyi1996ppo wants to merge 7 commits into

yuhua/m3.1-flashfrom

ganyi/m31-mxfp4-kv-index

Open

[MiniMax-M3.1] MXFP4 sparse KV cache and index cache#2770
ganyi1996ppo wants to merge 7 commits into
yuhua/m3.1-flashfrom
ganyi/m31-mxfp4-kv-index

Commits on Oct 28, 2026
- [MiniMax-M3.1] MXFP4 sparse KV pool and index-cache declaration
  
  ganyi1996ppo
  and
  claude
  committed
  65d02ee
- [MiniMax-M3.1] MXFP4 write path: one fused kernel writes K, V and the index key
  
  ganyi1996ppo
  and
  claude
  committed
  1204c92
- [MiniMax-M3.1] Score the MXFP4 index cache with aiter's FlyDSL scorers; page-128 block table
  
  ganyi1996ppo
  and
  claude
  committed
  b56b89f
- [MiniMax-M3.1] MXFP4 KV attention: aiter pa_decode_mxfp4, planned for decode and plan-free for prefill
  
  ganyi1996ppo
  and
  claude
  committed
  f14128e
- [MiniMax-M3.1] ATOM_M3_INDEX_Q_FP8: hand the MXFP4 index scorer an e4m3 query
  
  ganyi1996ppo
  and
  claude
  committed
  b65c7ae
- [MiniMax-M3.1] MXFP4 write path: pass the e4m3 main q as q_out
  
  ganyi1996ppo
  and
  claude
  committed
  6ab524a
Commits on Nov 2, 2026
- [MiniMax-M3.1] MXFP4 sparse attention: call aiter pa_decode directly
  
  ganyi1996ppo
  and
  claude
  committed
  6ae17ec