Allow BatchDecodeWithPagedKVCacheWrapper for GQA ratio 16 and 32#2895
Open
bkryu wants to merge 2 commits intoflashinfer-ai:mainfrom
Open
Allow BatchDecodeWithPagedKVCacheWrapper for GQA ratio 16 and 32#2895bkryu wants to merge 2 commits intoflashinfer-ai:mainfrom
bkryu wants to merge 2 commits intoflashinfer-ai:mainfrom
Commits
Commits on Mar 25, 2026
- committed
- committed
