Skip to content

Revert "feat: support cuda graph for batched multi-query(prefill/append) attention"#276

Merged
yzh119 merged 1 commit intomainfrom
revert-275-prefill-cuda-graph
Jun 2, 2024
Merged

Revert "feat: support cuda graph for batched multi-query(prefill/append) attention"#276
yzh119 merged 1 commit intomainfrom
revert-275-prefill-cuda-graph

Commits

Commits on Jun 2, 2024