[Benchmark] Add sampling parameters to benchmark_serving.#16022

DarkLight1337 merged 4 commits intovllm-project:mainvllm-project/vllm:mainfrom

hyeygit:bench_serving_no_basehyeygit/vllm:bench_serving_no_baseCopy head branch name to clipboard