[Benchmark] Add --async-engine
option to benchmark_throughput.py
#19377
Job | Run time |
---|---|
10s | |
13s | |
11s | |
8s | |
9s | |
51s |
--async-engine
option to benchmark_throughput.py
#19377
Job | Run time |
---|---|
10s | |
13s | |
11s | |
8s | |
9s | |
51s |