Skip to content

perf(cuda): split-KV FlashDecoding for attention_row decode (+10% V2-Lite wide-ctx) - #1340

Merged
justinchuby merged 1 commit into
mainfrom
squad/attention-splitkv-flashdecode
Aug 18, 2026
Merged

justinchuby merged 1 commit into
mainfrom
squad/attention-splitkv-flashdecode