Skip to content

Repository navigation

Enable CUDA-graph capture for causal fixed-capacity decode via on-device KV length - #1491

Merged
justinchuby merged 2 commits into
mainfrom
squad/kv-capture-causal-devlen
Aug 20, 2026
Merged

Enable CUDA-graph capture for causal fixed-capacity decode via on-device KV length#1491
justinchuby merged 2 commits into
mainfrom
squad/kv-capture-causal-devlen

fix(cuda): keep causal fixed-capacity decode on the monolithic attent…

82a9822
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar