[Benchmark] Add --async-engine
option to benchmark_throughput.py
#20964
Job | Run time |
---|---|
1m 49s | |
1m 40s | |
1m 38s | |
1m 7s | |
1m 10s | |
7m 24s |
--async-engine
option to benchmark_throughput.py
#20964
Job | Run time |
---|---|
1m 49s | |
1m 40s | |
1m 38s | |
1m 7s | |
1m 10s | |
7m 24s |