[Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline#20083

ywang96 merged 7 commits intovllm-project:mainvllm-project/vllm:mainfrom

ekagra-ranjan:er-fix-random-datasetekagra-ranjan/vllm:er-fix-random-datasetCopy head branch name to clipboard