Improve sampling benchmarks.#2374

vincentzed wants to merge 2 commits intoflashinfer-ai:mainflashinfer-ai/flashinfer:mainfrom

bzhng-development:vz/fix-benchmark-samplingbzhng-development/flashinfer:vz/fix-benchmark-samplingCopy head branch name to clipboard