perf: improve sampling/mask/softmax performance (part 1/2)#2044

yzh119 merged 3 commits intoflashinfer-ai:mainflashinfer-ai/flashinfer:mainfrom

yzh119:fix-sampling-fused-sfm-perfyzh119/flashinfer-dev:fix-sampling-fused-sfm-perfCopy head branch name to clipboard