Add tmp buffer and rotary mode to BatchDecode wrapper#2

yzh119 merged 1 commit intomainflashinfer-ai/flashinfer:mainfrom

batch-decode-tmp-rotaryflashinfer-ai/flashinfer:batch-decode-tmp-rotaryCopy head branch name to clipboard