[fmha-v2] Remove H2D transfer for bmm2 scale, enabling cuda graphs#2866

akhilg-nv wants to merge 2 commits intoflashinfer-ai:mainflashinfer-ai/flashinfer:mainfrom

akhilg-nv:fmha_cuda_graphakhilg-nv/flashinfer:fmha_cuda_graphCopy head branch name to clipboard