Skip to content

Remote store performance run for different workloads, cluster configurations and test configurations #9790

@ashking94

Description

@ashking94

We have run OSB for different workloads with the different configurations as below. We are able to see consistent improvements in the throughput for remote store runs.

Configuration 1 - Using r5.large, 6 shards 1 replica

  • 6 Shards 1 Replica
  • Cluster Configuration - 3 Nodes with data, ingest, master role
  • Instance Details - AWS EC2 r5.large
  • OSB host - Single AWS EC2 m5.2xlarge

Run Summary

Workload Index type Refresh interval Remote translog Buffer Interval Bulk client / Bulk Size Mean Indexing Throughput p50 Indexing Throughput Indexing Latency in ms (P90) Workload-params
so docrep 1s - 24/Default 13968.1 14280.9 12749.4 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1"}
so docrep 1s - 24/Default 14376.1 14440.5 13027.4 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1"}
so remote 10s Default (650ms) 24/Default 20013.9 19839.6 8500.81 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1","index_settings":{"index":{"refresh_interval":"10s"}}}
so remote 10s Default (650ms) 24/Default 19317.5 19033 8656.1 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1","index_settings":{"index":{"refresh_interval":"10s"}}}
http_logs docrep 1s - 24/Default 64797 65568.8 2708.08 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1"}
http_logs docrep 1s - 24/Default 67049.1 67361.2 2607.16 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1"}
http_logs remote 10s Default (650ms) 24/Default 83155.7 84021.1 2089.09 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1","index_settings":{"index":{"refresh_interval":"10s"}}}
http_logs remote 10s Default (650ms) 24/Default 78207.1 79566.2 2104.93 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1","index_settings":{"index":{"refresh_interval":"10s"}}}
nyc_taxis docrep - - 24/Default 35023.6 34574.6 9385.54 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1"}
nyc_taxis docrep - - 24/Default 36522.6 35788.6 9628.57 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1"}
nyc_taxis remote - Default (650ms) 24/Default 53046.1 52422.5 5978.72 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1",}
nyc_taxis remote - Default (650ms) 24/Default 51803.2 51571.8 6319.26 {"bulk_indexing_clients":"24","number_of_shards":"6","number_of_replicas":"1",}

Appendix

Abbreviations

bic - bulk indexing client
rbi - remote translog buffer interval
bs - bulk size
ri - refresh interval

Results for configuration 1

so, docrep, bic-24 (Run 1)

|                                                         Metric |                     Task |       Value |   Unit |
|---------------------------------------------------------------:|-------------------------:|------------:|-------:|
|                     Cumulative indexing time of primary shards |                          |     114.455 |    min |
|             Min cumulative indexing time across primary shards |                          |     17.2207 |    min |
|          Median cumulative indexing time across primary shards |                          |     19.3778 |    min |
|             Max cumulative indexing time across primary shards |                          |     21.4053 |    min |
|            Cumulative indexing throttle time of primary shards |                          |           0 |    min |
|    Min cumulative indexing throttle time across primary shards |                          |           0 |    min |
| Median cumulative indexing throttle time across primary shards |                          |           0 |    min |
|    Max cumulative indexing throttle time across primary shards |                          |           0 |    min |
|                        Cumulative merge time of primary shards |                          |     26.7914 |    min |
|                       Cumulative merge count of primary shards |                          |          25 |        |
|                Min cumulative merge time across primary shards |                          |     1.87663 |    min |
|             Median cumulative merge time across primary shards |                          |     4.68072 |    min |
|                Max cumulative merge time across primary shards |                          |     6.18075 |    min |
|               Cumulative merge throttle time of primary shards |                          |     9.04755 |    min |
|       Min cumulative merge throttle time across primary shards |                          |    0.703417 |    min |
|    Median cumulative merge throttle time across primary shards |                          |     1.50548 |    min |
|       Max cumulative merge throttle time across primary shards |                          |     2.11802 |    min |
|                      Cumulative refresh time of primary shards |                          |      24.988 |    min |
|                     Cumulative refresh count of primary shards |                          |         197 |        |
|              Min cumulative refresh time across primary shards |                          |     3.12418 |    min |
|           Median cumulative refresh time across primary shards |                          |     4.40324 |    min |
|              Max cumulative refresh time across primary shards |                          |     4.56643 |    min |
|                        Cumulative flush time of primary shards |                          |     16.6149 |    min |
|                       Cumulative flush count of primary shards |                          |          70 |        |
|                Min cumulative flush time across primary shards |                          |     1.90595 |    min |
|             Median cumulative flush time across primary shards |                          |     2.70427 |    min |
|                Max cumulative flush time across primary shards |                          |     3.84727 |    min |
|                                        Total Young Gen GC time |                          |       61.17 |      s |
|                                       Total Young Gen GC count |                          |         642 |        |
|                                          Total Old Gen GC time |                          |           0 |      s |
|                                         Total Old Gen GC count |                          |           0 |        |
|                                                     Store size |                          |     70.8439 |     GB |
|                                                  Translog size |                          | 6.14673e-07 |     GB |
|                                         Heap used for segments |                          |           0 |     MB |
|                                       Heap used for doc values |                          |           0 |     MB |
|                                            Heap used for terms |                          |           0 |     MB |
|                                            Heap used for norms |                          |           0 |     MB |
|                                           Heap used for points |                          |           0 |     MB |
|                                    Heap used for stored fields |                          |           0 |     MB |
|                                                  Segment count |                          |         217 |        |
|                                                 Min Throughput |             index-append |     12459.7 | docs/s |
|                                                Mean Throughput |             index-append |     13968.1 | docs/s |
|                                              Median Throughput |             index-append |     14280.9 | docs/s |
|                                                 Max Throughput |             index-append |       16311 | docs/s |
|                                        50th percentile latency |             index-append |     9352.44 |     ms |
|                                        90th percentile latency |             index-append |     12749.4 |     ms |
|                                        99th percentile latency |             index-append |     21783.8 |     ms |
|                                      99.9th percentile latency |             index-append |       35196 |     ms |
|                                     99.99th percentile latency |             index-append |             |        |
|                                       100th percentile latency |             index-append |       50567 |     ms |
|                                   50th percentile service time |             index-append |     9352.44 |     ms |
|                                   90th percentile service time |             index-append |     12749.4 |     ms |
|                                   99th percentile service time |             index-append |     21783.8 |     ms |
|                                 99.9th percentile service time |             index-append |       35196 |     ms |
|                                99.99th percentile service time |             index-append |             |        |
|                                  100th percentile service time |             index-append |       50567 |     ms |
|                                                     error rate |             index-append |           0 |      % |
|                                                 Min Throughput | wait-until-merges-finish |        0.02 |  ops/s |
|                                                Mean Throughput | wait-until-merges-finish |        0.02 |  ops/s |
|                                              Median Throughput | wait-until-merges-finish |        0.02 |  ops/s |
|                                                 Max Throughput | wait-until-merges-finish |        0.02 |  ops/s |
|                                        50th percentile latency | wait-until-merges-finish |             |        |
|                                        90th percentile latency | wait-until-merges-finish |             |        |
|                                        99th percentile latency | wait-until-merges-finish |             |        |
|                                      99.9th percentile latency | wait-until-merges-finish |             |        |
|                                     99.99th percentile latency | wait-until-merges-finish |             |        |
|                                       100th percentile latency | wait-until-merges-finish |     55241.8 |     ms |
|                                   50th percentile service time | wait-until-merges-finish |             |        |
|                                   90th percentile service time | wait-until-merges-finish |             |        |
|                                   99th percentile service time | wait-until-merges-finish |             |        |
|                                 99.9th percentile service time | wait-until-merges-finish |             |        |
|                                99.99th percentile service time | wait-until-merges-finish |             |        |
|                                  100th percentile service time | wait-until-merges-finish |     55241.8 |     ms |
|                                                     error rate | wait-until-merges-finish |           0 |      % |

so, docrep, bic-24 (Run 2)

|                                                         Metric |                     Task |       Value |   Unit |
|---------------------------------------------------------------:|-------------------------:|------------:|-------:|
|                     Cumulative indexing time of primary shards |                          |     110.292 |    min |
|             Min cumulative indexing time across primary shards |                          |     17.1682 |    min |
|          Median cumulative indexing time across primary shards |                          |      18.236 |    min |
|             Max cumulative indexing time across primary shards |                          |     20.0695 |    min |
|            Cumulative indexing throttle time of primary shards |                          |           0 |    min |
|    Min cumulative indexing throttle time across primary shards |                          |           0 |    min |
| Median cumulative indexing throttle time across primary shards |                          |           0 |    min |
|    Max cumulative indexing throttle time across primary shards |                          |           0 |    min |
|                        Cumulative merge time of primary shards |                          |     25.2738 |    min |
|                       Cumulative merge count of primary shards |                          |          27 |        |
|                Min cumulative merge time across primary shards |                          |     1.33825 |    min |
|             Median cumulative merge time across primary shards |                          |     4.55728 |    min |
|                Max cumulative merge time across primary shards |                          |     5.59335 |    min |
|               Cumulative merge throttle time of primary shards |                          |     9.53137 |    min |
|       Min cumulative merge throttle time across primary shards |                          |    0.549917 |    min |
|    Median cumulative merge throttle time across primary shards |                          |     1.52705 |    min |
|       Max cumulative merge throttle time across primary shards |                          |     2.57405 |    min |
|                      Cumulative refresh time of primary shards |                          |     25.6115 |    min |
|                     Cumulative refresh count of primary shards |                          |         201 |        |
|              Min cumulative refresh time across primary shards |                          |     3.76517 |    min |
|           Median cumulative refresh time across primary shards |                          |     4.09333 |    min |
|              Max cumulative refresh time across primary shards |                          |      5.5187 |    min |
|                        Cumulative flush time of primary shards |                          |     16.8697 |    min |
|                       Cumulative flush count of primary shards |                          |          69 |        |
|                Min cumulative flush time across primary shards |                          |     2.16655 |    min |
|             Median cumulative flush time across primary shards |                          |     2.74971 |    min |
|                Max cumulative flush time across primary shards |                          |     3.78457 |    min |
|                                        Total Young Gen GC time |                          |      59.655 |      s |
|                                       Total Young Gen GC count |                          |         622 |        |
|                                          Total Old Gen GC time |                          |           0 |      s |
|                                         Total Old Gen GC count |                          |           0 |        |
|                                                     Store size |                          |      72.084 |     GB |
|                                                  Translog size |                          | 6.14673e-07 |     GB |
|                                         Heap used for segments |                          |           0 |     MB |
|                                       Heap used for doc values |                          |           0 |     MB |
|                                            Heap used for terms |                          |           0 |     MB |
|                                            Heap used for norms |                          |           0 |     MB |
|                                           Heap used for points |                          |           0 |     MB |
|                                    Heap used for stored fields |                          |           0 |     MB |
|                                                  Segment count |                          |         235 |        |
|                                                 Min Throughput |             index-append |     12729.1 | docs/s |
|                                                Mean Throughput |             index-append |     14376.1 | docs/s |
|                                              Median Throughput |             index-append |     14440.5 | docs/s |
|                                                 Max Throughput |             index-append |     17443.4 | docs/s |
|                                        50th percentile latency |             index-append |     9016.47 |     ms |
|                                        90th percentile latency |             index-append |     13027.4 |     ms |
|                                        99th percentile latency |             index-append |     18164.9 |     ms |
|                                      99.9th percentile latency |             index-append |     27884.7 |     ms |
|                                     99.99th percentile latency |             index-append |             |        |
|                                       100th percentile latency |             index-append |     60584.9 |     ms |
|                                   50th percentile service time |             index-append |     9016.47 |     ms |
|                                   90th percentile service time |             index-append |     13027.4 |     ms |
|                                   99th percentile service time |             index-append |     18164.9 |     ms |
|                                 99.9th percentile service time |             index-append |     27884.7 |     ms |
|                                99.99th percentile service time |             index-append |             |        |
|                                  100th percentile service time |             index-append |     60584.9 |     ms |
|                                                     error rate |             index-append |           0 |      % |
|                                                 Min Throughput | wait-until-merges-finish |        0.01 |  ops/s |
|                                                Mean Throughput | wait-until-merges-finish |        0.01 |  ops/s |
|                                              Median Throughput | wait-until-merges-finish |        0.01 |  ops/s |
|                                                 Max Throughput | wait-until-merges-finish |        0.01 |  ops/s |
|                                        50th percentile latency | wait-until-merges-finish |             |        |
|                                        90th percentile latency | wait-until-merges-finish |             |        |
|                                        99th percentile latency | wait-until-merges-finish |             |        |
|                                      99.9th percentile latency | wait-until-merges-finish |             |        |
|                                     99.99th percentile latency | wait-until-merges-finish |             |        |
|                                       100th percentile latency | wait-until-merges-finish |      100100 |     ms |
|                                   50th percentile service time | wait-until-merges-finish |             |        |
|                                   90th percentile service time | wait-until-merges-finish |             |        |
|                                   99th percentile service time | wait-until-merges-finish |             |        |
|                                 99.9th percentile service time | wait-until-merges-finish |             |        |
|                                99.99th percentile service time | wait-until-merges-finish |             |        |
|                                  100th percentile service time | wait-until-merges-finish |      100100 |     ms |
|                                                     error rate | wait-until-merges-finish |           0 |      % |


----------------------------------
[INFO] SUCCESS (took 3029 seconds)
----------------------------------

so,remote,bic-24,ri-10s,bri-650ms (Run 1)

|                                                         Metric |                     Task |       Value |   Unit |
|---------------------------------------------------------------:|-------------------------:|------------:|-------:|
|                     Cumulative indexing time of primary shards |                          |      172.04 |    min |
|             Min cumulative indexing time across primary shards |                          |     26.9224 |    min |
|          Median cumulative indexing time across primary shards |                          |     28.5569 |    min |
|             Max cumulative indexing time across primary shards |                          |     30.3519 |    min |
|            Cumulative indexing throttle time of primary shards |                          |           0 |    min |
|    Min cumulative indexing throttle time across primary shards |                          |           0 |    min |
| Median cumulative indexing throttle time across primary shards |                          |           0 |    min |
|    Max cumulative indexing throttle time across primary shards |                          |           0 |    min |
|                        Cumulative merge time of primary shards |                          |     150.705 |    min |
|                       Cumulative merge count of primary shards |                          |         127 |        |
|                Min cumulative merge time across primary shards |                          |     14.3817 |    min |
|             Median cumulative merge time across primary shards |                          |     26.6883 |    min |
|                Max cumulative merge time across primary shards |                          |     30.7443 |    min |
|               Cumulative merge throttle time of primary shards |                          |      98.651 |    min |
|       Min cumulative merge throttle time across primary shards |                          |     7.89045 |    min |
|    Median cumulative merge throttle time across primary shards |                          |     18.1521 |    min |
|       Max cumulative merge throttle time across primary shards |                          |     19.9526 |    min |
|                      Cumulative refresh time of primary shards |                          |     30.4949 |    min |
|                     Cumulative refresh count of primary shards |                          |         683 |        |
|              Min cumulative refresh time across primary shards |                          |     4.75125 |    min |
|           Median cumulative refresh time across primary shards |                          |     4.95989 |    min |
|              Max cumulative refresh time across primary shards |                          |     5.55813 |    min |
|                        Cumulative flush time of primary shards |                          |     2.37727 |    min |
|                       Cumulative flush count of primary shards |                          |          26 |        |
|                Min cumulative flush time across primary shards |                          |      0.1545 |    min |
|             Median cumulative flush time across primary shards |                          |    0.313425 |    min |
|                Max cumulative flush time across primary shards |                          |    0.722817 |    min |
|                                        Total Young Gen GC time |                          |      17.347 |      s |
|                                       Total Young Gen GC count |                          |         396 |        |
|                                          Total Old Gen GC time |                          |           0 |      s |
|                                         Total Old Gen GC count |                          |           0 |        |
|                                                     Store size |                          |     73.5375 |     GB |
|                                                  Translog size |                          | 6.14673e-07 |     GB |
|                                         Heap used for segments |                          |           0 |     MB |
|                                       Heap used for doc values |                          |           0 |     MB |
|                                            Heap used for terms |                          |           0 |     MB |
|                                            Heap used for norms |                          |           0 |     MB |
|                                           Heap used for points |                          |           0 |     MB |
|                                    Heap used for stored fields |                          |           0 |     MB |
|                                                  Segment count |                          |         163 |        |
|                                                 Min Throughput |             index-append |     18806.5 | docs/s |
|                                                Mean Throughput |             index-append |     20013.9 | docs/s |
|                                              Median Throughput |             index-append |     19839.6 | docs/s |
|                                                 Max Throughput |             index-append |     22824.7 | docs/s |
|                                        50th percentile latency |             index-append |     6066.08 |     ms |
|                                        90th percentile latency |             index-append |     8500.81 |     ms |
|                                        99th percentile latency |             index-append |     11980.2 |     ms |
|                                      99.9th percentile latency |             index-append |     14263.2 |     ms |
|                                     99.99th percentile latency |             index-append |             |        |
|                                       100th percentile latency |             index-append |     15782.9 |     ms |
|                                   50th percentile service time |             index-append |     6066.08 |     ms |
|                                   90th percentile service time |             index-append |     8500.81 |     ms |
|                                   99th percentile service time |             index-append |     11980.2 |     ms |
|                                 99.9th percentile service time |             index-append |     14263.2 |     ms |
|                                99.99th percentile service time |             index-append |             |        |
|                                  100th percentile service time |             index-append |     15782.9 |     ms |
|                                                     error rate |             index-append |           0 |      % |
|                                                 Min Throughput | wait-until-merges-finish |           0 |  ops/s |
|                                                Mean Throughput | wait-until-merges-finish |           0 |  ops/s |
|                                              Median Throughput | wait-until-merges-finish |           0 |  ops/s |
|                                                 Max Throughput | wait-until-merges-finish |           0 |  ops/s |
|                                        50th percentile latency | wait-until-merges-finish |             |        |
|                                        90th percentile latency | wait-until-merges-finish |             |        |
|                                        99th percentile latency | wait-until-merges-finish |             |        |
|                                      99.9th percentile latency | wait-until-merges-finish |             |        |
|                                     99.99th percentile latency | wait-until-merges-finish |             |        |
|                                       100th percentile latency | wait-until-merges-finish |      857268 |     ms |
|                                   50th percentile service time | wait-until-merges-finish |             |        |
|                                   90th percentile service time | wait-until-merges-finish |             |        |
|                                   99th percentile service time | wait-until-merges-finish |             |        |
|                                 99.9th percentile service time | wait-until-merges-finish |             |        |
|                                99.99th percentile service time | wait-until-merges-finish |             |        |
|                                  100th percentile service time | wait-until-merges-finish |      857268 |     ms |
|                                                     error rate | wait-until-merges-finish |           0 |      % |

so,remote,bic-24,ri-10s,bri-650ms (Run 2)

|                                                         Metric |                     Task |      Value |   Unit |
|---------------------------------------------------------------:|-------------------------:|-----------:|-------:|
|                     Cumulative indexing time of primary shards |                          |    142.299 |    min |
|             Min cumulative indexing time across primary shards |                          |    0.09665 |    min |
|          Median cumulative indexing time across primary shards |                          |    28.4065 |    min |
|             Max cumulative indexing time across primary shards |                          |     30.238 |    min |
|            Cumulative indexing throttle time of primary shards |                          |          0 |    min |
|    Min cumulative indexing throttle time across primary shards |                          |          0 |    min |
| Median cumulative indexing throttle time across primary shards |                          |          0 |    min |
|    Max cumulative indexing throttle time across primary shards |                          |          0 |    min |
|                        Cumulative merge time of primary shards |                          |    86.1354 |    min |
|                       Cumulative merge count of primary shards |                          |        110 |        |
|                Min cumulative merge time across primary shards |                          |   0.474883 |    min |
|             Median cumulative merge time across primary shards |                          |      14.41 |    min |
|                Max cumulative merge time across primary shards |                          |     27.334 |    min |
|               Cumulative merge throttle time of primary shards |                          |    50.0146 |    min |
|       Min cumulative merge throttle time across primary shards |                          |   0.249433 |    min |
|    Median cumulative merge throttle time across primary shards |                          |    7.83618 |    min |
|       Max cumulative merge throttle time across primary shards |                          |    18.6518 |    min |
|                      Cumulative refresh time of primary shards |                          |    25.5143 |    min |
|                     Cumulative refresh count of primary shards |                          |        687 |        |
|              Min cumulative refresh time across primary shards |                          |     0.0328 |    min |
|           Median cumulative refresh time across primary shards |                          |    4.93388 |    min |
|              Max cumulative refresh time across primary shards |                          |     5.7074 |    min |
|                        Cumulative flush time of primary shards |                          |    2.72127 |    min |
|                       Cumulative flush count of primary shards |                          |         29 |        |
|                Min cumulative flush time across primary shards |                          |  0.0228333 |    min |
|             Median cumulative flush time across primary shards |                          |   0.479742 |    min |
|                Max cumulative flush time across primary shards |                          |    0.82545 |    min |
|                                        Total Young Gen GC time |                          |     17.257 |      s |
|                                       Total Young Gen GC count |                          |        361 |        |
|                                          Total Old Gen GC time |                          |          0 |      s |
|                                         Total Old Gen GC count |                          |          0 |        |
|                                                     Store size |                          |    65.7364 |     GB |
|                                                  Translog size |                          | 0.00556364 |     GB |
|                                         Heap used for segments |                          |          0 |     MB |
|                                       Heap used for doc values |                          |          0 |     MB |
|                                            Heap used for terms |                          |          0 |     MB |
|                                            Heap used for norms |                          |          0 |     MB |
|                                           Heap used for points |                          |          0 |     MB |
|                                    Heap used for stored fields |                          |          0 |     MB |
|                                                  Segment count |                          |        174 |        |
|                                                 Min Throughput |             index-append |    18290.8 | docs/s |
|                                                Mean Throughput |             index-append |    19317.5 | docs/s |
|                                              Median Throughput |             index-append |      19033 | docs/s |
|                                                 Max Throughput |             index-append |    21558.2 | docs/s |
|                                        50th percentile latency |             index-append |    6322.65 |     ms |
|                                        90th percentile latency |             index-append |     8656.1 |     ms |
|                                        99th percentile latency |             index-append |    11184.8 |     ms |
|                                      99.9th percentile latency |             index-append |    13370.4 |     ms |
|                                     99.99th percentile latency |             index-append |            |        |
|                                       100th percentile latency |             index-append |    15010.1 |     ms |
|                                   50th percentile service time |             index-append |    6322.65 |     ms |
|                                   90th percentile service time |             index-append |     8656.1 |     ms |
|                                   99th percentile service time |             index-append |    11184.8 |     ms |
|                                 99.9th percentile service time |             index-append |    13370.4 |     ms |
|                                99.99th percentile service time |             index-append |            |        |
|                                  100th percentile service time |             index-append |    15010.1 |     ms |
|                                                     error rate |             index-append |       0.06 |      % |
|                                                 Min Throughput | wait-until-merges-finish |          0 |  ops/s |
|                                                Mean Throughput | wait-until-merges-finish |          0 |  ops/s |
|                                              Median Throughput | wait-until-merges-finish |          0 |  ops/s |
|                                                 Max Throughput | wait-until-merges-finish |          0 |  ops/s |
|                                        50th percentile latency | wait-until-merges-finish |            |        |
|                                        90th percentile latency | wait-until-merges-finish |            |        |
|                                        99th percentile latency | wait-until-merges-finish |            |        |
|                                      99.9th percentile latency | wait-until-merges-finish |            |        |
|                                     99.99th percentile latency | wait-until-merges-finish |            |        |
|                                       100th percentile latency | wait-until-merges-finish |     722053 |     ms |
|                                   50th percentile service time | wait-until-merges-finish |            |        |
|                                   90th percentile service time | wait-until-merges-finish |            |        |
|                                   99th percentile service time | wait-until-merges-finish |            |        |
|                                 99.9th percentile service time | wait-until-merges-finish |            |        |
|                                99.99th percentile service time | wait-until-merges-finish |            |        |
|                                  100th percentile service time | wait-until-merges-finish |     722053 |     ms |
|                                                     error rate | wait-until-merges-finish |          0 |      % |

http_logs,docrep,bic-24 (Run 1)

|                                                         Metric |                                                   Task |       Value |    Unit |
|---------------------------------------------------------------:|-------------------------------------------------------:|------------:|--------:|
|                     Cumulative indexing time of primary shards |                                                        |     133.333 |     min |
|             Min cumulative indexing time across primary shards |                                                        |           0 |     min |
|          Median cumulative indexing time across primary shards |                                                        |    0.916483 |     min |
|             Max cumulative indexing time across primary shards |                                                        |     17.3902 |     min |
|            Cumulative indexing throttle time of primary shards |                                                        |           0 |     min |
|    Min cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
| Median cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|    Max cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|                        Cumulative merge time of primary shards |                                                        |     29.5956 |     min |
|                       Cumulative merge count of primary shards |                                                        |          70 |         |
|                Min cumulative merge time across primary shards |                                                        |           0 |     min |
|             Median cumulative merge time across primary shards |                                                        |   0.0892667 |     min |
|                Max cumulative merge time across primary shards |                                                        |     5.09587 |     min |
|               Cumulative merge throttle time of primary shards |                                                        |     3.80785 |     min |
|       Min cumulative merge throttle time across primary shards |                                                        |           0 |     min |
|    Median cumulative merge throttle time across primary shards |                                                        |           0 |     min |
|       Max cumulative merge throttle time across primary shards |                                                        |    0.881333 |     min |
|                      Cumulative refresh time of primary shards |                                                        |      20.318 |     min |
|                     Cumulative refresh count of primary shards |                                                        |         818 |         |
|              Min cumulative refresh time across primary shards |                                                        |           0 |     min |
|           Median cumulative refresh time across primary shards |                                                        |    0.218783 |     min |
|              Max cumulative refresh time across primary shards |                                                        |     2.56795 |     min |
|                        Cumulative flush time of primary shards |                                                        |     13.1379 |     min |
|                       Cumulative flush count of primary shards |                                                        |         146 |         |
|                Min cumulative flush time across primary shards |                                                        |           0 |     min |
|             Median cumulative flush time across primary shards |                                                        |   0.0421417 |     min |
|                Max cumulative flush time across primary shards |                                                        |     2.78772 |     min |
|                                        Total Young Gen GC time |                                                        |     166.944 |       s |
|                                       Total Young Gen GC count |                                                        |        2075 |         |
|                                          Total Old Gen GC time |                                                        |           0 |       s |
|                                         Total Old Gen GC count |                                                        |           0 |         |
|                                                     Store size |                                                        |     33.8708 |      GB |
|                                                  Translog size |                                                        | 4.91738e-06 |      GB |
|                                         Heap used for segments |                                                        |           0 |      MB |
|                                       Heap used for doc values |                                                        |           0 |      MB |
|                                            Heap used for terms |                                                        |           0 |      MB |
|                                            Heap used for norms |                                                        |           0 |      MB |
|                                           Heap used for points |                                                        |           0 |      MB |
|                                    Heap used for stored fields |                                                        |           0 |      MB |
|                                                  Segment count |                                                        |          42 |         |
|                                                 Min Throughput |                                           index-append |     60717.2 |  docs/s |
|                                                Mean Throughput |                                           index-append |       64797 |  docs/s |
|                                              Median Throughput |                                           index-append |     65568.8 |  docs/s |
|                                                 Max Throughput |                                           index-append |     66959.9 |  docs/s |
|                                        50th percentile latency |                                           index-append |     1746.95 |      ms |
|                                        90th percentile latency |                                           index-append |     2708.08 |      ms |
|                                        99th percentile latency |                                           index-append |     4070.75 |      ms |
|                                      99.9th percentile latency |                                           index-append |     10895.9 |      ms |
|                                     99.99th percentile latency |                                           index-append |     22404.4 |      ms |
|                                       100th percentile latency |                                           index-append |     26528.9 |      ms |
|                                   50th percentile service time |                                           index-append |     1746.95 |      ms |
|                                   90th percentile service time |                                           index-append |     2708.08 |      ms |
|                                   99th percentile service time |                                           index-append |     4070.75 |      ms |
|                                 99.9th percentile service time |                                           index-append |     10895.9 |      ms |
|                                99.99th percentile service time |                                           index-append |     22404.4 |      ms |
|                                  100th percentile service time |                                           index-append |     26528.9 |      ms |
|                                                     error rate |                                           index-append |           0 |       % |
|                                                 Min Throughput |                               wait-until-merges-finish |       27.55 |   ops/s |
|                                                Mean Throughput |                               wait-until-merges-finish |       27.55 |   ops/s |
|                                              Median Throughput |                               wait-until-merges-finish |       27.55 |   ops/s |
|                                                 Max Throughput |                               wait-until-merges-finish |       27.55 |   ops/s |
|                                        50th percentile latency |                               wait-until-merges-finish |             |         |
|                                        90th percentile latency |                               wait-until-merges-finish |             |         |
|                                        99th percentile latency |                               wait-until-merges-finish |             |         |
|                                      99.9th percentile latency |                               wait-until-merges-finish |             |         |
|                                     99.99th percentile latency |                               wait-until-merges-finish |             |         |
|                                       100th percentile latency |                               wait-until-merges-finish |     35.6845 |      ms |
|                                   50th percentile service time |                               wait-until-merges-finish |             |         |
|                                   90th percentile service time |                               wait-until-merges-finish |             |         |
|                                   99th percentile service time |                               wait-until-merges-finish |             |         |
|                                 99.9th percentile service time |                               wait-until-merges-finish |             |         |
|                                99.99th percentile service time |                               wait-until-merges-finish |             |         |
|                                  100th percentile service time |                               wait-until-merges-finish |     35.6845 |      ms |
|                                                     error rate |                               wait-until-merges-finish |           0 |       % |
|                                                 Min Throughput |                                                default |        7.97 |   ops/s |
|                                                Mean Throughput |                                                default |        7.97 |   ops/s |
|                                              Median Throughput |                                                default |        7.97 |   ops/s |
|                                                 Max Throughput |                                                default |        7.97 |   ops/s |
|                                        50th percentile latency |                                                default |     7.02868 |      ms |
|                                        90th percentile latency |                                                default |      8.5953 |      ms |
|                                        99th percentile latency |                                                default |      12.487 |      ms |
|                                      99.9th percentile latency |                                                default |             |         |
|                                     99.99th percentile latency |                                                default |             |         |
|                                       100th percentile latency |                                                default |     13.3263 |      ms |
|                                   50th percentile service time |                                                default |     5.29421 |      ms |
|                                   90th percentile service time |                                                default |     6.83067 |      ms |
|                                   99th percentile service time |                                                default |      11.439 |      ms |
|                                 99.9th percentile service time |                                                default |             |         |
|                                99.99th percentile service time |                                                default |             |         |
|                                  100th percentile service time |                                                default |     11.6446 |      ms |
|                                                     error rate |                                                default |           0 |       % |
|                                                 Min Throughput |                                                   term |       49.45 |   ops/s |
|                                                Mean Throughput |                                                   term |       49.48 |   ops/s |
|                                              Median Throughput |                                                   term |       49.48 |   ops/s |
|                                                 Max Throughput |                                                   term |        49.5 |   ops/s |
|                                        50th percentile latency |                                                   term |     8.11407 |      ms |
|                                        90th percentile latency |                                                   term |     10.2131 |      ms |
|                                        99th percentile latency |                                                   term |     12.1307 |      ms |
|                                      99.9th percentile latency |                                                   term |             |         |
|                                     99.99th percentile latency |                                                   term |             |         |
|                                       100th percentile latency |                                                   term |     13.0884 |      ms |
|                                   50th percentile service time |                                                   term |     6.70074 |      ms |
|                                   90th percentile service time |                                                   term |     8.91412 |      ms |
|                                   99th percentile service time |                                                   term |     11.1013 |      ms |
|                                 99.9th percentile service time |                                                   term |             |         |
|                                99.99th percentile service time |                                                   term |             |         |
|                                  100th percentile service time |                                                   term |     11.2426 |      ms |
|                                                     error rate |                                                   term |           0 |       % |
|                                                 Min Throughput |                                                  range |           1 |   ops/s |
|                                                Mean Throughput |                                                  range |        1.01 |   ops/s |
|                                              Median Throughput |                                                  range |        1.01 |   ops/s |
|                                                 Max Throughput |                                                  range |        1.01 |   ops/s |
|                                        50th percentile latency |                                                  range |      11.354 |      ms |
|                                        90th percentile latency |                                                  range |     13.8147 |      ms |
|                                        99th percentile latency |                                                  range |      16.696 |      ms |
|                                      99.9th percentile latency |                                                  range |             |         |
|                                     99.99th percentile latency |                                                  range |             |         |
|                                       100th percentile latency |                                                  range |     16.7178 |      ms |
|                                   50th percentile service time |                                                  range |     9.73689 |      ms |
|                                   90th percentile service time |                                                  range |     11.9682 |      ms |
|                                   99th percentile service time |                                                  range |     15.2398 |      ms |
|                                 99.9th percentile service time |                                                  range |             |         |
|                                99.99th percentile service time |                                                  range |             |         |
|                                  100th percentile service time |                                                  range |     15.4227 |      ms |
|                                                     error rate |                                                  range |           0 |       % |
|                                                 Min Throughput |                                          200s-in-range |       32.83 |   ops/s |
|                                                Mean Throughput |                                          200s-in-range |       32.84 |   ops/s |
|                                              Median Throughput |                                          200s-in-range |       32.84 |   ops/s |
|                                                 Max Throughput |                                          200s-in-range |       32.85 |   ops/s |
|                                        50th percentile latency |                                          200s-in-range |     8.91839 |      ms |
|                                        90th percentile latency |                                          200s-in-range |     12.2244 |      ms |
|                                        99th percentile latency |                                          200s-in-range |     16.8145 |      ms |
|                                      99.9th percentile latency |                                          200s-in-range |             |         |
|                                     99.99th percentile latency |                                          200s-in-range |             |         |
|                                       100th percentile latency |                                          200s-in-range |     18.0734 |      ms |
|                                   50th percentile service time |                                          200s-in-range |     7.99701 |      ms |
|                                   90th percentile service time |                                          200s-in-range |     11.5843 |      ms |
|                                   99th percentile service time |                                          200s-in-range |     15.9256 |      ms |
|                                 99.9th percentile service time |                                          200s-in-range |             |         |
|                                99.99th percentile service time |                                          200s-in-range |             |         |
|                                  100th percentile service time |                                          200s-in-range |     17.5955 |      ms |
|                                                     error rate |                                          200s-in-range |           0 |       % |
|                                                 Min Throughput |                                          400s-in-range |       49.94 |   ops/s |
|                                                Mean Throughput |                                          400s-in-range |       49.95 |   ops/s |
|                                              Median Throughput |                                          400s-in-range |       49.95 |   ops/s |
|                                                 Max Throughput |                                          400s-in-range |       49.95 |   ops/s |
|                                        50th percentile latency |                                          400s-in-range |     6.03231 |      ms |
|                                        90th percentile latency |                                          400s-in-range |     7.23765 |      ms |
|                                        99th percentile latency |                                          400s-in-range |     10.1454 |      ms |
|                                      99.9th percentile latency |                                          400s-in-range |             |         |
|                                     99.99th percentile latency |                                          400s-in-range |             |         |
|                                       100th percentile latency |                                          400s-in-range |     12.9462 |      ms |
|                                   50th percentile service time |                                          400s-in-range |     5.17197 |      ms |
|                                   90th percentile service time |                                          400s-in-range |     6.22814 |      ms |
|                                   99th percentile service time |                                          400s-in-range |     9.22896 |      ms |
|                                 99.9th percentile service time |                                          400s-in-range |             |         |
|                                99.99th percentile service time |                                          400s-in-range |             |         |
|                                  100th percentile service time |                                          400s-in-range |     12.3969 |      ms |
|                                                     error rate |                                          400s-in-range |           0 |       % |
|                                                 Min Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                Mean Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                              Median Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                 Max Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                        50th percentile latency |                                             hourly_agg |      3226.2 |      ms |
|                                        90th percentile latency |                                             hourly_agg |     3350.21 |      ms |
|                                        99th percentile latency |                                             hourly_agg |     3428.95 |      ms |
|                                      99.9th percentile latency |                                             hourly_agg |             |         |
|                                     99.99th percentile latency |                                             hourly_agg |             |         |
|                                       100th percentile latency |                                             hourly_agg |      3469.4 |      ms |
|                                   50th percentile service time |                                             hourly_agg |      3223.5 |      ms |
|                                   90th percentile service time |                                             hourly_agg |     3347.06 |      ms |
|                                   99th percentile service time |                                             hourly_agg |     3425.85 |      ms |
|                                 99.9th percentile service time |                                             hourly_agg |             |         |
|                                99.99th percentile service time |                                             hourly_agg |             |         |
|                                  100th percentile service time |                                             hourly_agg |      3467.1 |      ms |
|                                                     error rate |                                             hourly_agg |           0 |       % |
|                                                 Min Throughput |                                                 scroll |       24.96 | pages/s |
|                                                Mean Throughput |                                                 scroll |       24.98 | pages/s |
|                                              Median Throughput |                                                 scroll |       24.98 | pages/s |
|                                                 Max Throughput |                                                 scroll |       24.98 | pages/s |
|                                        50th percentile latency |                                                 scroll |     538.195 |      ms |
|                                        90th percentile latency |                                                 scroll |     584.604 |      ms |
|                                        99th percentile latency |                                                 scroll |     743.932 |      ms |
|                                      99.9th percentile latency |                                                 scroll |             |         |
|                                     99.99th percentile latency |                                                 scroll |             |         |
|                                       100th percentile latency |                                                 scroll |     947.148 |      ms |
|                                   50th percentile service time |                                                 scroll |     536.743 |      ms |
|                                   90th percentile service time |                                                 scroll |     583.331 |      ms |
|                                   99th percentile service time |                                                 scroll |     742.531 |      ms |
|                                 99.9th percentile service time |                                                 scroll |             |         |
|                                99.99th percentile service time |                                                 scroll |             |         |
|                                  100th percentile service time |                                                 scroll |     945.925 |      ms |
|                                                     error rate |                                                 scroll |           0 |       % |
|                                                 Min Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                    desc_sort_timestamp |     116.118 |      ms |
|                                        90th percentile latency |                                    desc_sort_timestamp |     153.241 |      ms |
|                                        99th percentile latency |                                    desc_sort_timestamp |     182.602 |      ms |
|                                      99.9th percentile latency |                                    desc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                    desc_sort_timestamp |             |         |
|                                       100th percentile latency |                                    desc_sort_timestamp |     201.038 |      ms |
|                                   50th percentile service time |                                    desc_sort_timestamp |     113.357 |      ms |
|                                   90th percentile service time |                                    desc_sort_timestamp |     150.568 |      ms |
|                                   99th percentile service time |                                    desc_sort_timestamp |     180.905 |      ms |
|                                 99.9th percentile service time |                                    desc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                    desc_sort_timestamp |             |         |
|                                  100th percentile service time |                                    desc_sort_timestamp |     198.162 |      ms |
|                                                     error rate |                                    desc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                     asc_sort_timestamp |     10.1293 |      ms |
|                                        90th percentile latency |                                     asc_sort_timestamp |     11.6825 |      ms |
|                                        99th percentile latency |                                     asc_sort_timestamp |     16.9844 |      ms |
|                                      99.9th percentile latency |                                     asc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                     asc_sort_timestamp |             |         |
|                                       100th percentile latency |                                     asc_sort_timestamp |     24.4486 |      ms |
|                                   50th percentile service time |                                     asc_sort_timestamp |     7.57608 |      ms |
|                                   90th percentile service time |                                     asc_sort_timestamp |     9.23958 |      ms |
|                                   99th percentile service time |                                     asc_sort_timestamp |     14.7651 |      ms |
|                                 99.9th percentile service time |                                     asc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                     asc_sort_timestamp |             |         |
|                                  100th percentile service time |                                     asc_sort_timestamp |     21.1904 |      ms |
|                                                     error rate |                                     asc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                         desc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                         desc_sort_with_after_timestamp |        0.54 |   ops/s |
|                                        50th percentile latency |                         desc_sort_with_after_timestamp |     194.517 |      ms |
|                                        90th percentile latency |                         desc_sort_with_after_timestamp |     222.342 |      ms |
|                                        99th percentile latency |                         desc_sort_with_after_timestamp |     251.231 |      ms |
|                                      99.9th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                         desc_sort_with_after_timestamp |      256.04 |      ms |
|                                   50th percentile service time |                         desc_sort_with_after_timestamp |     191.776 |      ms |
|                                   90th percentile service time |                         desc_sort_with_after_timestamp |     220.132 |      ms |
|                                   99th percentile service time |                         desc_sort_with_after_timestamp |     248.773 |      ms |
|                                 99.9th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                         desc_sort_with_after_timestamp |     253.557 |      ms |
|                                                     error rate |                         desc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                          asc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                          asc_sort_with_after_timestamp |        0.55 |   ops/s |
|                                        50th percentile latency |                          asc_sort_with_after_timestamp |     12.4596 |      ms |
|                                        90th percentile latency |                          asc_sort_with_after_timestamp |     15.4538 |      ms |
|                                        99th percentile latency |                          asc_sort_with_after_timestamp |     18.1168 |      ms |
|                                      99.9th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                          asc_sort_with_after_timestamp |     21.6304 |      ms |
|                                   50th percentile service time |                          asc_sort_with_after_timestamp |     10.0214 |      ms |
|                                   90th percentile service time |                          asc_sort_with_after_timestamp |     12.7455 |      ms |
|                                   99th percentile service time |                          asc_sort_with_after_timestamp |     15.2533 |      ms |
|                                 99.9th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                          asc_sort_with_after_timestamp |     18.4944 |      ms |
|                                                     error rate |                          asc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                         wait-until-merges-1-seg-finish |       29.14 |   ops/s |
|                                                Mean Throughput |                         wait-until-merges-1-seg-finish |       29.14 |   ops/s |
|                                              Median Throughput |                         wait-until-merges-1-seg-finish |       29.14 |   ops/s |
|                                                 Max Throughput |                         wait-until-merges-1-seg-finish |       29.14 |   ops/s |
|                                        50th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        90th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                      99.9th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                     99.99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                       100th percentile latency |                         wait-until-merges-1-seg-finish |     33.7297 |      ms |
|                                   50th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   90th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                 99.9th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                99.99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                  100th percentile service time |                         wait-until-merges-1-seg-finish |     33.7297 |      ms |
|                                                     error rate |                         wait-until-merges-1-seg-finish |           0 |       % |
|                                                 Min Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                                Mean Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                              Median Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                                 Max Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                        50th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     276.999 |      ms |
|                                        90th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     303.391 |      ms |
|                                        99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     349.492 |      ms |
|                                      99.9th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     350.185 |      ms |
|                                   50th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     276.213 |      ms |
|                                   90th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     301.903 |      ms |
|                                   99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     347.321 |      ms |
|                                 99.9th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     348.149 |      ms |
|                                                     error rate |            desc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                Mean Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                              Median Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                 Max Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                        50th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |      11.021 |      ms |
|                                        90th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     13.0055 |      ms |
|                                        99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     14.8803 |      ms |
|                                      99.9th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     15.1771 |      ms |
|                                   50th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     9.97655 |      ms |
|                                   90th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     11.4836 |      ms |
|                                   99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     13.5347 |      ms |
|                                 99.9th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     13.5759 |      ms |
|                                                     error rate |             asc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.54 |   ops/s |
|                                        50th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |       200.3 |      ms |
|                                        90th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     224.152 |      ms |
|                                        99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     252.751 |      ms |
|                                      99.9th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |      294.99 |      ms |
|                                   50th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |      197.83 |      ms |
|                                   90th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     222.666 |      ms |
|                                   99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |      250.33 |      ms |
|                                 99.9th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     292.227 |      ms |
|                                                     error rate | desc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.55 |   ops/s |
|                                        50th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     48.1817 |      ms |
|                                        90th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     55.9074 |      ms |
|                                        99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     61.9364 |      ms |
|                                      99.9th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     65.7088 |      ms |
|                                   50th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     46.0766 |      ms |
|                                   90th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     54.6314 |      ms |
|                                   99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     61.0294 |      ms |
|                                 99.9th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     62.9261 |      ms |
|                                                     error rate |  asc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |


----------------------------------
[INFO] SUCCESS (took 8747 seconds)
----------------------------------

http_logs,docrep,bic-24 (Run 2)

|                                                         Metric |                                                   Task |       Value |    Unit |
|---------------------------------------------------------------:|-------------------------------------------------------:|------------:|--------:|
|                     Cumulative indexing time of primary shards |                                                        |     131.721 |     min |
|             Min cumulative indexing time across primary shards |                                                        |           0 |     min |
|          Median cumulative indexing time across primary shards |                                                        |    0.988708 |     min |
|             Max cumulative indexing time across primary shards |                                                        |     17.8964 |     min |
|            Cumulative indexing throttle time of primary shards |                                                        |           0 |     min |
|    Min cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
| Median cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|    Max cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|                        Cumulative merge time of primary shards |                                                        |     25.8192 |     min |
|                       Cumulative merge count of primary shards |                                                        |          71 |         |
|                Min cumulative merge time across primary shards |                                                        |           0 |     min |
|             Median cumulative merge time across primary shards |                                                        |   0.0899833 |     min |
|                Max cumulative merge time across primary shards |                                                        |     5.07528 |     min |
|               Cumulative merge throttle time of primary shards |                                                        |     3.17128 |     min |
|       Min cumulative merge throttle time across primary shards |                                                        |           0 |     min |
|    Median cumulative merge throttle time across primary shards |                                                        |           0 |     min |
|       Max cumulative merge throttle time across primary shards |                                                        |      0.8565 |     min |
|                      Cumulative refresh time of primary shards |                                                        |     20.4898 |     min |
|                     Cumulative refresh count of primary shards |                                                        |         819 |         |
|              Min cumulative refresh time across primary shards |                                                        |           0 |     min |
|           Median cumulative refresh time across primary shards |                                                        |    0.220358 |     min |
|              Max cumulative refresh time across primary shards |                                                        |      2.5494 |     min |
|                        Cumulative flush time of primary shards |                                                        |     10.5104 |     min |
|                       Cumulative flush count of primary shards |                                                        |         144 |         |
|                Min cumulative flush time across primary shards |                                                        |           0 |     min |
|             Median cumulative flush time across primary shards |                                                        |    0.024375 |     min |
|                Max cumulative flush time across primary shards |                                                        |     2.21608 |     min |
|                                        Total Young Gen GC time |                                                        |     165.436 |       s |
|                                       Total Young Gen GC count |                                                        |        2060 |         |
|                                          Total Old Gen GC time |                                                        |           0 |       s |
|                                         Total Old Gen GC count |                                                        |           0 |         |
|                                                     Store size |                                                        |     33.8781 |      GB |
|                                                  Translog size |                                                        | 4.91738e-06 |      GB |
|                                         Heap used for segments |                                                        |           0 |      MB |
|                                       Heap used for doc values |                                                        |           0 |      MB |
|                                            Heap used for terms |                                                        |           0 |      MB |
|                                            Heap used for norms |                                                        |           0 |      MB |
|                                           Heap used for points |                                                        |           0 |      MB |
|                                    Heap used for stored fields |                                                        |           0 |      MB |
|                                                  Segment count |                                                        |          42 |         |
|                                                 Min Throughput |                                           index-append |     62169.7 |  docs/s |
|                                                Mean Throughput |                                           index-append |     67049.1 |  docs/s |
|                                              Median Throughput |                                           index-append |     67361.2 |  docs/s |
|                                                 Max Throughput |                                           index-append |     72818.5 |  docs/s |
|                                        50th percentile latency |                                           index-append |     1757.78 |      ms |
|                                        90th percentile latency |                                           index-append |     2607.16 |      ms |
|                                        99th percentile latency |                                           index-append |     3881.16 |      ms |
|                                      99.9th percentile latency |                                           index-append |     10768.9 |      ms |
|                                     99.99th percentile latency |                                           index-append |     20432.9 |      ms |
|                                       100th percentile latency |                                           index-append |     33889.3 |      ms |
|                                   50th percentile service time |                                           index-append |     1757.78 |      ms |
|                                   90th percentile service time |                                           index-append |     2607.16 |      ms |
|                                   99th percentile service time |                                           index-append |     3881.16 |      ms |
|                                 99.9th percentile service time |                                           index-append |     10768.9 |      ms |
|                                99.99th percentile service time |                                           index-append |     20432.9 |      ms |
|                                  100th percentile service time |                                           index-append |     33889.3 |      ms |
|                                                     error rate |                                           index-append |           0 |       % |
|                                                 Min Throughput |                               wait-until-merges-finish |        0.01 |   ops/s |
|                                                Mean Throughput |                               wait-until-merges-finish |        0.01 |   ops/s |
|                                              Median Throughput |                               wait-until-merges-finish |        0.01 |   ops/s |
|                                                 Max Throughput |                               wait-until-merges-finish |        0.01 |   ops/s |
|                                        50th percentile latency |                               wait-until-merges-finish |             |         |
|                                        90th percentile latency |                               wait-until-merges-finish |             |         |
|                                        99th percentile latency |                               wait-until-merges-finish |             |         |
|                                      99.9th percentile latency |                               wait-until-merges-finish |             |         |
|                                     99.99th percentile latency |                               wait-until-merges-finish |             |         |
|                                       100th percentile latency |                               wait-until-merges-finish |     73864.1 |      ms |
|                                   50th percentile service time |                               wait-until-merges-finish |             |         |
|                                   90th percentile service time |                               wait-until-merges-finish |             |         |
|                                   99th percentile service time |                               wait-until-merges-finish |             |         |
|                                 99.9th percentile service time |                               wait-until-merges-finish |             |         |
|                                99.99th percentile service time |                               wait-until-merges-finish |             |         |
|                                  100th percentile service time |                               wait-until-merges-finish |     73864.1 |      ms |
|                                                     error rate |                               wait-until-merges-finish |           0 |       % |
|                                                 Min Throughput |                                                default |        8.01 |   ops/s |
|                                                Mean Throughput |                                                default |        8.01 |   ops/s |
|                                              Median Throughput |                                                default |        8.01 |   ops/s |
|                                                 Max Throughput |                                                default |        8.01 |   ops/s |
|                                        50th percentile latency |                                                default |     5.42994 |      ms |
|                                        90th percentile latency |                                                default |      6.1692 |      ms |
|                                        99th percentile latency |                                                default |     6.78539 |      ms |
|                                      99.9th percentile latency |                                                default |             |         |
|                                     99.99th percentile latency |                                                default |             |         |
|                                       100th percentile latency |                                                default |     7.05159 |      ms |
|                                   50th percentile service time |                                                default |     4.41577 |      ms |
|                                   90th percentile service time |                                                default |     4.63914 |      ms |
|                                   99th percentile service time |                                                default |     5.11656 |      ms |
|                                 99.9th percentile service time |                                                default |             |         |
|                                99.99th percentile service time |                                                default |             |         |
|                                  100th percentile service time |                                                default |     5.57454 |      ms |
|                                                     error rate |                                                default |           0 |       % |
|                                                 Min Throughput |                                                   term |       49.63 |   ops/s |
|                                                Mean Throughput |                                                   term |       49.64 |   ops/s |
|                                              Median Throughput |                                                   term |       49.64 |   ops/s |
|                                                 Max Throughput |                                                   term |       49.66 |   ops/s |
|                                        50th percentile latency |                                                   term |     7.34431 |      ms |
|                                        90th percentile latency |                                                   term |     8.21164 |      ms |
|                                        99th percentile latency |                                                   term |     8.69457 |      ms |
|                                      99.9th percentile latency |                                                   term |             |         |
|                                     99.99th percentile latency |                                                   term |             |         |
|                                       100th percentile latency |                                                   term |     11.0237 |      ms |
|                                   50th percentile service time |                                                   term |     6.08136 |      ms |
|                                   90th percentile service time |                                                   term |     6.60548 |      ms |
|                                   99th percentile service time |                                                   term |     7.29271 |      ms |
|                                 99.9th percentile service time |                                                   term |             |         |
|                                99.99th percentile service time |                                                   term |             |         |
|                                  100th percentile service time |                                                   term |     9.58338 |      ms |
|                                                     error rate |                                                   term |           0 |       % |
|                                                 Min Throughput |                                                  range |           1 |   ops/s |
|                                                Mean Throughput |                                                  range |        1.01 |   ops/s |
|                                              Median Throughput |                                                  range |        1.01 |   ops/s |
|                                                 Max Throughput |                                                  range |        1.01 |   ops/s |
|                                        50th percentile latency |                                                  range |      13.361 |      ms |
|                                        90th percentile latency |                                                  range |     14.8972 |      ms |
|                                        99th percentile latency |                                                  range |     17.7073 |      ms |
|                                      99.9th percentile latency |                                                  range |             |         |
|                                     99.99th percentile latency |                                                  range |             |         |
|                                       100th percentile latency |                                                  range |     21.3705 |      ms |
|                                   50th percentile service time |                                                  range |      11.371 |      ms |
|                                   90th percentile service time |                                                  range |     12.8476 |      ms |
|                                   99th percentile service time |                                                  range |     15.9071 |      ms |
|                                 99.9th percentile service time |                                                  range |             |         |
|                                99.99th percentile service time |                                                  range |             |         |
|                                  100th percentile service time |                                                  range |      18.787 |      ms |
|                                                     error rate |                                                  range |           0 |       % |
|                                                 Min Throughput |                                          200s-in-range |       32.99 |   ops/s |
|                                                Mean Throughput |                                          200s-in-range |       32.99 |   ops/s |
|                                              Median Throughput |                                          200s-in-range |       32.99 |   ops/s |
|                                                 Max Throughput |                                          200s-in-range |       32.99 |   ops/s |
|                                        50th percentile latency |                                          200s-in-range |     8.59151 |      ms |
|                                        90th percentile latency |                                          200s-in-range |      10.382 |      ms |
|                                        99th percentile latency |                                          200s-in-range |      11.525 |      ms |
|                                      99.9th percentile latency |                                          200s-in-range |             |         |
|                                     99.99th percentile latency |                                          200s-in-range |             |         |
|                                       100th percentile latency |                                          200s-in-range |     12.7522 |      ms |
|                                   50th percentile service time |                                          200s-in-range |     7.76262 |      ms |
|                                   90th percentile service time |                                          200s-in-range |     9.50643 |      ms |
|                                   99th percentile service time |                                          200s-in-range |     10.7138 |      ms |
|                                 99.9th percentile service time |                                          200s-in-range |             |         |
|                                99.99th percentile service time |                                          200s-in-range |             |         |
|                                  100th percentile service time |                                          200s-in-range |     11.6511 |      ms |
|                                                     error rate |                                          200s-in-range |           0 |       % |
|                                                 Min Throughput |                                          400s-in-range |          50 |   ops/s |
|                                                Mean Throughput |                                          400s-in-range |          50 |   ops/s |
|                                              Median Throughput |                                          400s-in-range |          50 |   ops/s |
|                                                 Max Throughput |                                          400s-in-range |          50 |   ops/s |
|                                        50th percentile latency |                                          400s-in-range |     5.20267 |      ms |
|                                        90th percentile latency |                                          400s-in-range |     6.02521 |      ms |
|                                        99th percentile latency |                                          400s-in-range |     6.58512 |      ms |
|                                      99.9th percentile latency |                                          400s-in-range |             |         |
|                                     99.99th percentile latency |                                          400s-in-range |             |         |
|                                       100th percentile latency |                                          400s-in-range |     8.36251 |      ms |
|                                   50th percentile service time |                                          400s-in-range |     4.43097 |      ms |
|                                   90th percentile service time |                                          400s-in-range |     5.14362 |      ms |
|                                   99th percentile service time |                                          400s-in-range |     5.47119 |      ms |
|                                 99.9th percentile service time |                                          400s-in-range |             |         |
|                                99.99th percentile service time |                                          400s-in-range |             |         |
|                                  100th percentile service time |                                          400s-in-range |     7.16229 |      ms |
|                                                     error rate |                                          400s-in-range |           0 |       % |
|                                                 Min Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                Mean Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                              Median Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                 Max Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                        50th percentile latency |                                             hourly_agg |     3360.17 |      ms |
|                                        90th percentile latency |                                             hourly_agg |     3421.77 |      ms |
|                                        99th percentile latency |                                             hourly_agg |     3473.77 |      ms |
|                                      99.9th percentile latency |                                             hourly_agg |             |         |
|                                     99.99th percentile latency |                                             hourly_agg |             |         |
|                                       100th percentile latency |                                             hourly_agg |      3477.8 |      ms |
|                                   50th percentile service time |                                             hourly_agg |     3357.88 |      ms |
|                                   90th percentile service time |                                             hourly_agg |      3419.1 |      ms |
|                                   99th percentile service time |                                             hourly_agg |     3471.17 |      ms |
|                                 99.9th percentile service time |                                             hourly_agg |             |         |
|                                99.99th percentile service time |                                             hourly_agg |             |         |
|                                  100th percentile service time |                                             hourly_agg |     3476.61 |      ms |
|                                                     error rate |                                             hourly_agg |           0 |       % |
|                                                 Min Throughput |                                                 scroll |       25.03 | pages/s |
|                                                Mean Throughput |                                                 scroll |       25.05 | pages/s |
|                                              Median Throughput |                                                 scroll |       25.05 | pages/s |
|                                                 Max Throughput |                                                 scroll |        25.1 | pages/s |
|                                        50th percentile latency |                                                 scroll |     561.454 |      ms |
|                                        90th percentile latency |                                                 scroll |     602.525 |      ms |
|                                        99th percentile latency |                                                 scroll |     847.018 |      ms |
|                                      99.9th percentile latency |                                                 scroll |             |         |
|                                     99.99th percentile latency |                                                 scroll |             |         |
|                                       100th percentile latency |                                                 scroll |     903.396 |      ms |
|                                   50th percentile service time |                                                 scroll |     559.712 |      ms |
|                                   90th percentile service time |                                                 scroll |     600.726 |      ms |
|                                   99th percentile service time |                                                 scroll |     845.016 |      ms |
|                                 99.9th percentile service time |                                                 scroll |             |         |
|                                99.99th percentile service time |                                                 scroll |             |         |
|                                  100th percentile service time |                                                 scroll |     902.295 |      ms |
|                                                     error rate |                                                 scroll |           0 |       % |
|                                                 Min Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                    desc_sort_timestamp |     112.602 |      ms |
|                                        90th percentile latency |                                    desc_sort_timestamp |     161.829 |      ms |
|                                        99th percentile latency |                                    desc_sort_timestamp |      185.02 |      ms |
|                                      99.9th percentile latency |                                    desc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                    desc_sort_timestamp |             |         |
|                                       100th percentile latency |                                    desc_sort_timestamp |     198.042 |      ms |
|                                   50th percentile service time |                                    desc_sort_timestamp |     108.725 |      ms |
|                                   90th percentile service time |                                    desc_sort_timestamp |     158.756 |      ms |
|                                   99th percentile service time |                                    desc_sort_timestamp |     182.424 |      ms |
|                                 99.9th percentile service time |                                    desc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                    desc_sort_timestamp |             |         |
|                                  100th percentile service time |                                    desc_sort_timestamp |     195.011 |      ms |
|                                                     error rate |                                    desc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                     asc_sort_timestamp |     9.59216 |      ms |
|                                        90th percentile latency |                                     asc_sort_timestamp |     11.2697 |      ms |
|                                        99th percentile latency |                                     asc_sort_timestamp |     15.3794 |      ms |
|                                      99.9th percentile latency |                                     asc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                     asc_sort_timestamp |             |         |
|                                       100th percentile latency |                                     asc_sort_timestamp |     328.095 |      ms |
|                                   50th percentile service time |                                     asc_sort_timestamp |     7.39149 |      ms |
|                                   90th percentile service time |                                     asc_sort_timestamp |     8.64702 |      ms |
|                                   99th percentile service time |                                     asc_sort_timestamp |     12.3307 |      ms |
|                                 99.9th percentile service time |                                     asc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                     asc_sort_timestamp |             |         |
|                                  100th percentile service time |                                     asc_sort_timestamp |     325.086 |      ms |
|                                                     error rate |                                     asc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                         desc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                         desc_sort_with_after_timestamp |        0.54 |   ops/s |
|                                        50th percentile latency |                         desc_sort_with_after_timestamp |     199.694 |      ms |
|                                        90th percentile latency |                         desc_sort_with_after_timestamp |     232.433 |      ms |
|                                        99th percentile latency |                         desc_sort_with_after_timestamp |     251.766 |      ms |
|                                      99.9th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                         desc_sort_with_after_timestamp |     253.875 |      ms |
|                                   50th percentile service time |                         desc_sort_with_after_timestamp |     196.399 |      ms |
|                                   90th percentile service time |                         desc_sort_with_after_timestamp |     231.613 |      ms |
|                                   99th percentile service time |                         desc_sort_with_after_timestamp |     250.976 |      ms |
|                                 99.9th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                         desc_sort_with_after_timestamp |     251.597 |      ms |
|                                                     error rate |                         desc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                          asc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                          asc_sort_with_after_timestamp |        0.55 |   ops/s |
|                                        50th percentile latency |                          asc_sort_with_after_timestamp |     10.7918 |      ms |
|                                        90th percentile latency |                          asc_sort_with_after_timestamp |     11.9547 |      ms |
|                                        99th percentile latency |                          asc_sort_with_after_timestamp |     13.6805 |      ms |
|                                      99.9th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                          asc_sort_with_after_timestamp |     16.2472 |      ms |
|                                   50th percentile service time |                          asc_sort_with_after_timestamp |      8.4639 |      ms |
|                                   90th percentile service time |                          asc_sort_with_after_timestamp |     9.48912 |      ms |
|                                   99th percentile service time |                          asc_sort_with_after_timestamp |     10.6422 |      ms |
|                                 99.9th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                          asc_sort_with_after_timestamp |      14.444 |      ms |
|                                                     error rate |                          asc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                         wait-until-merges-1-seg-finish |       52.14 |   ops/s |
|                                                Mean Throughput |                         wait-until-merges-1-seg-finish |       52.14 |   ops/s |
|                                              Median Throughput |                         wait-until-merges-1-seg-finish |       52.14 |   ops/s |
|                                                 Max Throughput |                         wait-until-merges-1-seg-finish |       52.14 |   ops/s |
|                                        50th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        90th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                      99.9th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                     99.99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                       100th percentile latency |                         wait-until-merges-1-seg-finish |     18.5744 |      ms |
|                                   50th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   90th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                 99.9th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                99.99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                  100th percentile service time |                         wait-until-merges-1-seg-finish |     18.5744 |      ms |
|                                                     error rate |                         wait-until-merges-1-seg-finish |           0 |       % |
|                                                 Min Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                                Mean Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                              Median Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                                 Max Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                        50th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     235.927 |      ms |
|                                        90th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     297.068 |      ms |
|                                        99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     306.319 |      ms |
|                                      99.9th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     311.942 |      ms |
|                                   50th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     234.762 |      ms |
|                                   90th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     296.117 |      ms |
|                                   99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     304.592 |      ms |
|                                 99.9th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     310.987 |      ms |
|                                                     error rate |            desc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                Mean Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                              Median Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                 Max Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                        50th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     12.1118 |      ms |
|                                        90th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     13.6598 |      ms |
|                                        99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     15.8833 |      ms |
|                                      99.9th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     16.5428 |      ms |
|                                   50th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     10.9654 |      ms |
|                                   90th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |      12.292 |      ms |
|                                   99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     14.5254 |      ms |
|                                 99.9th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     15.6817 |      ms |
|                                                     error rate |             asc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.53 |   ops/s |
|                                        50th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |      181.06 |      ms |
|                                        90th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     196.762 |      ms |
|                                        99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     211.176 |      ms |
|                                      99.9th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     255.604 |      ms |
|                                   50th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     179.353 |      ms |
|                                   90th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     194.426 |      ms |
|                                   99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     209.644 |      ms |
|                                 99.9th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |      253.24 |      ms |
|                                                     error rate | desc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.55 |   ops/s |
|                                        50th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     41.6164 |      ms |
|                                        90th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |      56.693 |      ms |
|                                        99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     67.5295 |      ms |
|                                      99.9th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     68.5078 |      ms |
|                                   50th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     38.7932 |      ms |
|                                   90th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     54.5373 |      ms |
|                                   99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     65.3345 |      ms |
|                                 99.9th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     66.5449 |      ms |
|                                                     error rate |  asc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |


----------------------------------
[INFO] SUCCESS (took 8716 seconds)
----------------------------------

http_logs,remote,bic-24,ri-10s,bri-650ms (Run 1)

|                                                         Metric |                                                   Task |       Value |    Unit |
|---------------------------------------------------------------:|-------------------------------------------------------:|------------:|--------:|
|                     Cumulative indexing time of primary shards |                                                        |     243.899 |     min |
|             Min cumulative indexing time across primary shards |                                                        |           0 |     min |
|          Median cumulative indexing time across primary shards |                                                        |     1.71882 |     min |
|             Max cumulative indexing time across primary shards |                                                        |     34.3129 |     min |
|            Cumulative indexing throttle time of primary shards |                                                        |           0 |     min |
|    Min cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
| Median cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|    Max cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|                        Cumulative merge time of primary shards |                                                        |     90.4196 |     min |
|                       Cumulative merge count of primary shards |                                                        |         300 |         |
|                Min cumulative merge time across primary shards |                                                        |           0 |     min |
|             Median cumulative merge time across primary shards |                                                        |    0.365033 |     min |
|                Max cumulative merge time across primary shards |                                                        |     13.5249 |     min |
|               Cumulative merge throttle time of primary shards |                                                        |      32.217 |     min |
|       Min cumulative merge throttle time across primary shards |                                                        |           0 |     min |
|    Median cumulative merge throttle time across primary shards |                                                        |    0.044325 |     min |
|       Max cumulative merge throttle time across primary shards |                                                        |     5.45342 |     min |
|                      Cumulative refresh time of primary shards |                                                        |     25.5317 |     min |
|                     Cumulative refresh count of primary shards |                                                        |        2012 |         |
|              Min cumulative refresh time across primary shards |                                                        |           0 |     min |
|           Median cumulative refresh time across primary shards |                                                        |     0.17295 |     min |
|              Max cumulative refresh time across primary shards |                                                        |     3.27083 |     min |
|                        Cumulative flush time of primary shards |                                                        |     1.87372 |     min |
|                       Cumulative flush count of primary shards |                                                        |         126 |         |
|                Min cumulative flush time across primary shards |                                                        | 0.000183333 |     min |
|             Median cumulative flush time across primary shards |                                                        |    0.004025 |     min |
|                Max cumulative flush time across primary shards |                                                        |      0.3854 |     min |
|                                        Total Young Gen GC time |                                                        |      36.579 |       s |
|                                       Total Young Gen GC count |                                                        |         995 |         |
|                                          Total Old Gen GC time |                                                        |           0 |       s |
|                                         Total Old Gen GC count |                                                        |           0 |         |
|                                                     Store size |                                                        |     35.2043 |      GB |
|                                                  Translog size |                                                        | 4.91738e-06 |      GB |
|                                         Heap used for segments |                                                        |           0 |      MB |
|                                       Heap used for doc values |                                                        |           0 |      MB |
|                                            Heap used for terms |                                                        |           0 |      MB |
|                                            Heap used for norms |                                                        |           0 |      MB |
|                                           Heap used for points |                                                        |           0 |      MB |
|                                    Heap used for stored fields |                                                        |           0 |      MB |
|                                                  Segment count |                                                        |          42 |         |
|                                                 Min Throughput |                                           index-append |     75413.9 |  docs/s |
|                                                Mean Throughput |                                           index-append |     83155.7 |  docs/s |
|                                              Median Throughput |                                           index-append |     84021.1 |  docs/s |
|                                                 Max Throughput |                                           index-append |       88412 |  docs/s |
|                                        50th percentile latency |                                           index-append |     1379.71 |      ms |
|                                        90th percentile latency |                                           index-append |     2089.09 |      ms |
|                                        99th percentile latency |                                           index-append |     2887.72 |      ms |
|                                      99.9th percentile latency |                                           index-append |     3474.38 |      ms |
|                                     99.99th percentile latency |                                           index-append |     3913.71 |      ms |
|                                       100th percentile latency |                                           index-append |     4538.23 |      ms |
|                                   50th percentile service time |                                           index-append |     1379.71 |      ms |
|                                   90th percentile service time |                                           index-append |     2089.09 |      ms |
|                                   99th percentile service time |                                           index-append |     2887.72 |      ms |
|                                 99.9th percentile service time |                                           index-append |     3474.38 |      ms |
|                                99.99th percentile service time |                                           index-append |     3913.71 |      ms |
|                                  100th percentile service time |                                           index-append |     4538.23 |      ms |
|                                                     error rate |                                           index-append |           0 |       % |
|                                                 Min Throughput |                               wait-until-merges-finish |       12.66 |   ops/s |
|                                                Mean Throughput |                               wait-until-merges-finish |       12.66 |   ops/s |
|                                              Median Throughput |                               wait-until-merges-finish |       12.66 |   ops/s |
|                                                 Max Throughput |                               wait-until-merges-finish |       12.66 |   ops/s |
|                                        50th percentile latency |                               wait-until-merges-finish |             |         |
|                                        90th percentile latency |                               wait-until-merges-finish |             |         |
|                                        99th percentile latency |                               wait-until-merges-finish |             |         |
|                                      99.9th percentile latency |                               wait-until-merges-finish |             |         |
|                                     99.99th percentile latency |                               wait-until-merges-finish |             |         |
|                                       100th percentile latency |                               wait-until-merges-finish |     78.5112 |      ms |
|                                   50th percentile service time |                               wait-until-merges-finish |             |         |
|                                   90th percentile service time |                               wait-until-merges-finish |             |         |
|                                   99th percentile service time |                               wait-until-merges-finish |             |         |
|                                 99.9th percentile service time |                               wait-until-merges-finish |             |         |
|                                99.99th percentile service time |                               wait-until-merges-finish |             |         |
|                                  100th percentile service time |                               wait-until-merges-finish |     78.5112 |      ms |
|                                                     error rate |                               wait-until-merges-finish |           0 |       % |
|                                                 Min Throughput |                                                default |        7.99 |   ops/s |
|                                                Mean Throughput |                                                default |        7.99 |   ops/s |
|                                              Median Throughput |                                                default |        7.99 |   ops/s |
|                                                 Max Throughput |                                                default |        7.99 |   ops/s |
|                                        50th percentile latency |                                                default |     7.30949 |      ms |
|                                        90th percentile latency |                                                default |     8.70003 |      ms |
|                                        99th percentile latency |                                                default |     11.4446 |      ms |
|                                      99.9th percentile latency |                                                default |             |         |
|                                     99.99th percentile latency |                                                default |             |         |
|                                       100th percentile latency |                                                default |     13.5198 |      ms |
|                                   50th percentile service time |                                                default |     5.74037 |      ms |
|                                   90th percentile service time |                                                default |     7.03842 |      ms |
|                                   99th percentile service time |                                                default |     9.10095 |      ms |
|                                 99.9th percentile service time |                                                default |             |         |
|                                99.99th percentile service time |                                                default |             |         |
|                                  100th percentile service time |                                                default |      11.275 |      ms |
|                                                     error rate |                                                default |           0 |       % |
|                                                 Min Throughput |                                                   term |       49.41 |   ops/s |
|                                                Mean Throughput |                                                   term |       49.44 |   ops/s |
|                                              Median Throughput |                                                   term |       49.44 |   ops/s |
|                                                 Max Throughput |                                                   term |       49.46 |   ops/s |
|                                        50th percentile latency |                                                   term |     9.21367 |      ms |
|                                        90th percentile latency |                                                   term |      10.794 |      ms |
|                                        99th percentile latency |                                                   term |     14.0087 |      ms |
|                                      99.9th percentile latency |                                                   term |             |         |
|                                     99.99th percentile latency |                                                   term |             |         |
|                                       100th percentile latency |                                                   term |     14.0468 |      ms |
|                                   50th percentile service time |                                                   term |     8.37353 |      ms |
|                                   90th percentile service time |                                                   term |     10.0078 |      ms |
|                                   99th percentile service time |                                                   term |     12.8309 |      ms |
|                                 99.9th percentile service time |                                                   term |             |         |
|                                99.99th percentile service time |                                                   term |             |         |
|                                  100th percentile service time |                                                   term |     13.7534 |      ms |
|                                                     error rate |                                                   term |           0 |       % |
|                                                 Min Throughput |                                                  range |           1 |   ops/s |
|                                                Mean Throughput |                                                  range |        1.01 |   ops/s |
|                                              Median Throughput |                                                  range |        1.01 |   ops/s |
|                                                 Max Throughput |                                                  range |        1.01 |   ops/s |
|                                        50th percentile latency |                                                  range |     13.4384 |      ms |
|                                        90th percentile latency |                                                  range |     15.7938 |      ms |
|                                        99th percentile latency |                                                  range |     18.5861 |      ms |
|                                      99.9th percentile latency |                                                  range |             |         |
|                                     99.99th percentile latency |                                                  range |             |         |
|                                       100th percentile latency |                                                  range |     19.4285 |      ms |
|                                   50th percentile service time |                                                  range |     11.5017 |      ms |
|                                   90th percentile service time |                                                  range |     14.1488 |      ms |
|                                   99th percentile service time |                                                  range |     16.8445 |      ms |
|                                 99.9th percentile service time |                                                  range |             |         |
|                                99.99th percentile service time |                                                  range |             |         |
|                                  100th percentile service time |                                                  range |     17.7068 |      ms |
|                                                     error rate |                                                  range |           0 |       % |
|                                                 Min Throughput |                                          200s-in-range |       32.84 |   ops/s |
|                                                Mean Throughput |                                          200s-in-range |       32.85 |   ops/s |
|                                              Median Throughput |                                          200s-in-range |       32.85 |   ops/s |
|                                                 Max Throughput |                                          200s-in-range |       32.86 |   ops/s |
|                                        50th percentile latency |                                          200s-in-range |     9.23236 |      ms |
|                                        90th percentile latency |                                          200s-in-range |     12.4212 |      ms |
|                                        99th percentile latency |                                          200s-in-range |     15.8735 |      ms |
|                                      99.9th percentile latency |                                          200s-in-range |             |         |
|                                     99.99th percentile latency |                                          200s-in-range |             |         |
|                                       100th percentile latency |                                          200s-in-range |     18.6052 |      ms |
|                                   50th percentile service time |                                          200s-in-range |     8.18362 |      ms |
|                                   90th percentile service time |                                          200s-in-range |     11.2612 |      ms |
|                                   99th percentile service time |                                          200s-in-range |     15.1192 |      ms |
|                                 99.9th percentile service time |                                          200s-in-range |             |         |
|                                99.99th percentile service time |                                          200s-in-range |             |         |
|                                  100th percentile service time |                                          200s-in-range |     17.6669 |      ms |
|                                                     error rate |                                          200s-in-range |           0 |       % |
|                                                 Min Throughput |                                          400s-in-range |       49.95 |   ops/s |
|                                                Mean Throughput |                                          400s-in-range |       49.96 |   ops/s |
|                                              Median Throughput |                                          400s-in-range |       49.96 |   ops/s |
|                                                 Max Throughput |                                          400s-in-range |       49.96 |   ops/s |
|                                        50th percentile latency |                                          400s-in-range |     5.78699 |      ms |
|                                        90th percentile latency |                                          400s-in-range |     6.98783 |      ms |
|                                        99th percentile latency |                                          400s-in-range |     8.08313 |      ms |
|                                      99.9th percentile latency |                                          400s-in-range |             |         |
|                                     99.99th percentile latency |                                          400s-in-range |             |         |
|                                       100th percentile latency |                                          400s-in-range |     12.0686 |      ms |
|                                   50th percentile service time |                                          400s-in-range |     4.96752 |      ms |
|                                   90th percentile service time |                                          400s-in-range |     6.03033 |      ms |
|                                   99th percentile service time |                                          400s-in-range |     7.14605 |      ms |
|                                 99.9th percentile service time |                                          400s-in-range |             |         |
|                                99.99th percentile service time |                                          400s-in-range |             |         |
|                                  100th percentile service time |                                          400s-in-range |     10.8169 |      ms |
|                                                     error rate |                                          400s-in-range |           0 |       % |
|                                                 Min Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                Mean Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                              Median Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                 Max Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                        50th percentile latency |                                             hourly_agg |     3788.76 |      ms |
|                                        90th percentile latency |                                             hourly_agg |     4579.05 |      ms |
|                                        99th percentile latency |                                             hourly_agg |     4947.89 |      ms |
|                                      99.9th percentile latency |                                             hourly_agg |             |         |
|                                     99.99th percentile latency |                                             hourly_agg |             |         |
|                                       100th percentile latency |                                             hourly_agg |     4959.17 |      ms |
|                                   50th percentile service time |                                             hourly_agg |     3786.84 |      ms |
|                                   90th percentile service time |                                             hourly_agg |     4577.12 |      ms |
|                                   99th percentile service time |                                             hourly_agg |     4946.41 |      ms |
|                                 99.9th percentile service time |                                             hourly_agg |             |         |
|                                99.99th percentile service time |                                             hourly_agg |             |         |
|                                  100th percentile service time |                                             hourly_agg |     4958.02 |      ms |
|                                                     error rate |                                             hourly_agg |           0 |       % |
|                                                 Min Throughput |                                                 scroll |       24.84 | pages/s |
|                                                Mean Throughput |                                                 scroll |       24.96 | pages/s |
|                                              Median Throughput |                                                 scroll |       24.96 | pages/s |
|                                                 Max Throughput |                                                 scroll |       24.98 | pages/s |
|                                        50th percentile latency |                                                 scroll |     556.857 |      ms |
|                                        90th percentile latency |                                                 scroll |     620.327 |      ms |
|                                        99th percentile latency |                                                 scroll |     1211.94 |      ms |
|                                      99.9th percentile latency |                                                 scroll |             |         |
|                                     99.99th percentile latency |                                                 scroll |             |         |
|                                       100th percentile latency |                                                 scroll |     2107.16 |      ms |
|                                   50th percentile service time |                                                 scroll |     555.176 |      ms |
|                                   90th percentile service time |                                                 scroll |     617.416 |      ms |
|                                   99th percentile service time |                                                 scroll |     639.998 |      ms |
|                                 99.9th percentile service time |                                                 scroll |             |         |
|                                99.99th percentile service time |                                                 scroll |             |         |
|                                  100th percentile service time |                                                 scroll |     2105.14 |      ms |
|                                                     error rate |                                                 scroll |           0 |       % |
|                                                 Min Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                    desc_sort_timestamp |     142.155 |      ms |
|                                        90th percentile latency |                                    desc_sort_timestamp |     237.314 |      ms |
|                                        99th percentile latency |                                    desc_sort_timestamp |     262.572 |      ms |
|                                      99.9th percentile latency |                                    desc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                    desc_sort_timestamp |             |         |
|                                       100th percentile latency |                                    desc_sort_timestamp |     262.688 |      ms |
|                                   50th percentile service time |                                    desc_sort_timestamp |     140.794 |      ms |
|                                   90th percentile service time |                                    desc_sort_timestamp |     235.548 |      ms |
|                                   99th percentile service time |                                    desc_sort_timestamp |      260.34 |      ms |
|                                 99.9th percentile service time |                                    desc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                    desc_sort_timestamp |             |         |
|                                  100th percentile service time |                                    desc_sort_timestamp |     261.254 |      ms |
|                                                     error rate |                                    desc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                     asc_sort_timestamp |     11.3973 |      ms |
|                                        90th percentile latency |                                     asc_sort_timestamp |     14.6765 |      ms |
|                                        99th percentile latency |                                     asc_sort_timestamp |     27.1948 |      ms |
|                                      99.9th percentile latency |                                     asc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                     asc_sort_timestamp |             |         |
|                                       100th percentile latency |                                     asc_sort_timestamp |     52.8753 |      ms |
|                                   50th percentile service time |                                     asc_sort_timestamp |     8.94394 |      ms |
|                                   90th percentile service time |                                     asc_sort_timestamp |     12.2394 |      ms |
|                                   99th percentile service time |                                     asc_sort_timestamp |     25.2115 |      ms |
|                                 99.9th percentile service time |                                     asc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                     asc_sort_timestamp |             |         |
|                                  100th percentile service time |                                     asc_sort_timestamp |     51.2788 |      ms |
|                                                     error rate |                                     asc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                         desc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                         desc_sort_with_after_timestamp |        0.55 |   ops/s |
|                                        50th percentile latency |                         desc_sort_with_after_timestamp |     108.331 |      ms |
|                                        90th percentile latency |                         desc_sort_with_after_timestamp |     168.142 |      ms |
|                                        99th percentile latency |                         desc_sort_with_after_timestamp |     171.741 |      ms |
|                                      99.9th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                         desc_sort_with_after_timestamp |     172.975 |      ms |
|                                   50th percentile service time |                         desc_sort_with_after_timestamp |     105.471 |      ms |
|                                   90th percentile service time |                         desc_sort_with_after_timestamp |     166.378 |      ms |
|                                   99th percentile service time |                         desc_sort_with_after_timestamp |     168.904 |      ms |
|                                 99.9th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                         desc_sort_with_after_timestamp |     169.316 |      ms |
|                                                     error rate |                         desc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                          asc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                          asc_sort_with_after_timestamp |        0.55 |   ops/s |
|                                        50th percentile latency |                          asc_sort_with_after_timestamp |     42.8702 |      ms |
|                                        90th percentile latency |                          asc_sort_with_after_timestamp |     51.6736 |      ms |
|                                        99th percentile latency |                          asc_sort_with_after_timestamp |     60.5976 |      ms |
|                                      99.9th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                          asc_sort_with_after_timestamp |     78.0527 |      ms |
|                                   50th percentile service time |                          asc_sort_with_after_timestamp |     40.8591 |      ms |
|                                   90th percentile service time |                          asc_sort_with_after_timestamp |     49.3633 |      ms |
|                                   99th percentile service time |                          asc_sort_with_after_timestamp |     57.3054 |      ms |
|                                 99.9th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                          asc_sort_with_after_timestamp |     75.1534 |      ms |
|                                                     error rate |                          asc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                         wait-until-merges-1-seg-finish |       52.07 |   ops/s |
|                                                Mean Throughput |                         wait-until-merges-1-seg-finish |       52.07 |   ops/s |
|                                              Median Throughput |                         wait-until-merges-1-seg-finish |       52.07 |   ops/s |
|                                                 Max Throughput |                         wait-until-merges-1-seg-finish |       52.07 |   ops/s |
|                                        50th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        90th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                      99.9th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                     99.99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                       100th percentile latency |                         wait-until-merges-1-seg-finish |     18.6197 |      ms |
|                                   50th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   90th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                 99.9th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                99.99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                  100th percentile service time |                         wait-until-merges-1-seg-finish |     18.6197 |      ms |
|                                                     error rate |                         wait-until-merges-1-seg-finish |           0 |       % |
|                                                 Min Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                                Mean Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                              Median Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                                 Max Throughput |            desc-sort-timestamp-after-force-merge-1-seg |           2 |   ops/s |
|                                        50th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     51.8613 |      ms |
|                                        90th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |      67.898 |      ms |
|                                        99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     68.7873 |      ms |
|                                      99.9th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     71.3603 |      ms |
|                                   50th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     50.7784 |      ms |
|                                   90th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     66.7115 |      ms |
|                                   99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     67.1848 |      ms |
|                                 99.9th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |      70.141 |      ms |
|                                                     error rate |            desc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                Mean Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                              Median Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                 Max Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                        50th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     10.7656 |      ms |
|                                        90th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     12.9686 |      ms |
|                                        99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     16.6664 |      ms |
|                                      99.9th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     17.2395 |      ms |
|                                   50th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |      9.3976 |      ms |
|                                   90th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     11.4979 |      ms |
|                                   99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     15.7794 |      ms |
|                                 99.9th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     16.0006 |      ms |
|                                                     error rate |             asc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.55 |   ops/s |
|                                        50th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     75.5013 |      ms |
|                                        90th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     89.6105 |      ms |
|                                        99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     105.408 |      ms |
|                                      99.9th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |      113.01 |      ms |
|                                   50th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     73.1106 |      ms |
|                                   90th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |      87.042 |      ms |
|                                   99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     103.848 |      ms |
|                                 99.9th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     110.167 |      ms |
|                                                     error rate | desc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.55 |   ops/s |
|                                        50th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     66.4225 |      ms |
|                                        90th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     86.6332 |      ms |
|                                        99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |      88.748 |      ms |
|                                      99.9th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     105.402 |      ms |
|                                   50th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     63.6731 |      ms |
|                                   90th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |      83.861 |      ms |
|                                   99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     85.8659 |      ms |
|                                 99.9th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     102.788 |      ms |
|                                                     error rate |  asc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |


----------------------------------
[INFO] SUCCESS (took 7586 seconds)
----------------------------------

http_logs,remote,bic-24,ri-10s,bri-650ms (Run 2)

|                                                         Metric |                                                   Task |       Value |    Unit |
|---------------------------------------------------------------:|-------------------------------------------------------:|------------:|--------:|
|                     Cumulative indexing time of primary shards |                                                        |     253.029 |     min |
|             Min cumulative indexing time across primary shards |                                                        |           0 |     min |
|          Median cumulative indexing time across primary shards |                                                        |     1.72462 |     min |
|             Max cumulative indexing time across primary shards |                                                        |     37.9658 |     min |
|            Cumulative indexing throttle time of primary shards |                                                        |           0 |     min |
|    Min cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
| Median cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|    Max cumulative indexing throttle time across primary shards |                                                        |           0 |     min |
|                        Cumulative merge time of primary shards |                                                        |     90.3634 |     min |
|                       Cumulative merge count of primary shards |                                                        |         312 |         |
|                Min cumulative merge time across primary shards |                                                        |           0 |     min |
|             Median cumulative merge time across primary shards |                                                        |    0.336083 |     min |
|                Max cumulative merge time across primary shards |                                                        |     14.3837 |     min |
|               Cumulative merge throttle time of primary shards |                                                        |     33.4595 |     min |
|       Min cumulative merge throttle time across primary shards |                                                        |           0 |     min |
|    Median cumulative merge throttle time across primary shards |                                                        |   0.0413667 |     min |
|       Max cumulative merge throttle time across primary shards |                                                        |     5.56843 |     min |
|                      Cumulative refresh time of primary shards |                                                        |     24.9825 |     min |
|                     Cumulative refresh count of primary shards |                                                        |        2062 |         |
|              Min cumulative refresh time across primary shards |                                                        |           0 |     min |
|           Median cumulative refresh time across primary shards |                                                        |    0.186167 |     min |
|              Max cumulative refresh time across primary shards |                                                        |     3.34678 |     min |
|                        Cumulative flush time of primary shards |                                                        |     1.62975 |     min |
|                       Cumulative flush count of primary shards |                                                        |         126 |         |
|                Min cumulative flush time across primary shards |                                                        |     0.00015 |     min |
|             Median cumulative flush time across primary shards |                                                        |  0.00371667 |     min |
|                Max cumulative flush time across primary shards |                                                        |    0.311217 |     min |
|                                        Total Young Gen GC time |                                                        |      35.567 |       s |
|                                       Total Young Gen GC count |                                                        |         992 |         |
|                                          Total Old Gen GC time |                                                        |           0 |       s |
|                                         Total Old Gen GC count |                                                        |           0 |         |
|                                                     Store size |                                                        |     37.4547 |      GB |
|                                                  Translog size |                                                        | 4.91738e-06 |      GB |
|                                         Heap used for segments |                                                        |           0 |      MB |
|                                       Heap used for doc values |                                                        |           0 |      MB |
|                                            Heap used for terms |                                                        |           0 |      MB |
|                                            Heap used for norms |                                                        |           0 |      MB |
|                                           Heap used for points |                                                        |           0 |      MB |
|                                    Heap used for stored fields |                                                        |           0 |      MB |
|                                                  Segment count |                                                        |          42 |         |
|                                                 Min Throughput |                                           index-append |       66840 |  docs/s |
|                                                Mean Throughput |                                           index-append |     78207.1 |  docs/s |
|                                              Median Throughput |                                           index-append |     79566.2 |  docs/s |
|                                                 Max Throughput |                                           index-append |     81848.9 |  docs/s |
|                                        50th percentile latency |                                           index-append |     1422.92 |      ms |
|                                        90th percentile latency |                                           index-append |     2104.93 |      ms |
|                                        99th percentile latency |                                           index-append |     2918.75 |      ms |
|                                      99.9th percentile latency |                                           index-append |     3445.95 |      ms |
|                                     99.99th percentile latency |                                           index-append |     4194.41 |      ms |
|                                       100th percentile latency |                                           index-append |      4580.5 |      ms |
|                                   50th percentile service time |                                           index-append |     1422.92 |      ms |
|                                   90th percentile service time |                                           index-append |     2104.93 |      ms |
|                                   99th percentile service time |                                           index-append |     2918.75 |      ms |
|                                 99.9th percentile service time |                                           index-append |     3445.95 |      ms |
|                                99.99th percentile service time |                                           index-append |     4194.41 |      ms |
|                                  100th percentile service time |                                           index-append |      4580.5 |      ms |
|                                                     error rate |                                           index-append |        0.03 |       % |
|                                                 Min Throughput |                               wait-until-merges-finish |        0.21 |   ops/s |
|                                                Mean Throughput |                               wait-until-merges-finish |        0.21 |   ops/s |
|                                              Median Throughput |                               wait-until-merges-finish |        0.21 |   ops/s |
|                                                 Max Throughput |                               wait-until-merges-finish |        0.21 |   ops/s |
|                                        50th percentile latency |                               wait-until-merges-finish |             |         |
|                                        90th percentile latency |                               wait-until-merges-finish |             |         |
|                                        99th percentile latency |                               wait-until-merges-finish |             |         |
|                                      99.9th percentile latency |                               wait-until-merges-finish |             |         |
|                                     99.99th percentile latency |                               wait-until-merges-finish |             |         |
|                                       100th percentile latency |                               wait-until-merges-finish |     4752.64 |      ms |
|                                   50th percentile service time |                               wait-until-merges-finish |             |         |
|                                   90th percentile service time |                               wait-until-merges-finish |             |         |
|                                   99th percentile service time |                               wait-until-merges-finish |             |         |
|                                 99.9th percentile service time |                               wait-until-merges-finish |             |         |
|                                99.99th percentile service time |                               wait-until-merges-finish |             |         |
|                                  100th percentile service time |                               wait-until-merges-finish |     4752.64 |      ms |
|                                                     error rate |                               wait-until-merges-finish |           0 |       % |
|                                                 Min Throughput |                                                default |        7.99 |   ops/s |
|                                                Mean Throughput |                                                default |        7.99 |   ops/s |
|                                              Median Throughput |                                                default |        7.99 |   ops/s |
|                                                 Max Throughput |                                                default |        7.99 |   ops/s |
|                                        50th percentile latency |                                                default |     7.24466 |      ms |
|                                        90th percentile latency |                                                default |     8.68874 |      ms |
|                                        99th percentile latency |                                                default |     10.3467 |      ms |
|                                      99.9th percentile latency |                                                default |             |         |
|                                     99.99th percentile latency |                                                default |             |         |
|                                       100th percentile latency |                                                default |     12.3058 |      ms |
|                                   50th percentile service time |                                                default |      5.5013 |      ms |
|                                   90th percentile service time |                                                default |     7.12103 |      ms |
|                                   99th percentile service time |                                                default |     8.77897 |      ms |
|                                 99.9th percentile service time |                                                default |             |         |
|                                99.99th percentile service time |                                                default |             |         |
|                                  100th percentile service time |                                                default |     10.0805 |      ms |
|                                                     error rate |                                                default |           0 |       % |
|                                                 Min Throughput |                                                   term |        49.4 |   ops/s |
|                                                Mean Throughput |                                                   term |       49.43 |   ops/s |
|                                              Median Throughput |                                                   term |       49.43 |   ops/s |
|                                                 Max Throughput |                                                   term |       49.46 |   ops/s |
|                                        50th percentile latency |                                                   term |     9.42077 |      ms |
|                                        90th percentile latency |                                                   term |      11.531 |      ms |
|                                        99th percentile latency |                                                   term |     15.8405 |      ms |
|                                      99.9th percentile latency |                                                   term |             |         |
|                                     99.99th percentile latency |                                                   term |             |         |
|                                       100th percentile latency |                                                   term |      16.876 |      ms |
|                                   50th percentile service time |                                                   term |      8.5068 |      ms |
|                                   90th percentile service time |                                                   term |     10.5351 |      ms |
|                                   99th percentile service time |                                                   term |     14.6379 |      ms |
|                                 99.9th percentile service time |                                                   term |             |         |
|                                99.99th percentile service time |                                                   term |             |         |
|                                  100th percentile service time |                                                   term |     15.8331 |      ms |
|                                                     error rate |                                                   term |           0 |       % |
|                                                 Min Throughput |                                                  range |           1 |   ops/s |
|                                                Mean Throughput |                                                  range |        1.01 |   ops/s |
|                                              Median Throughput |                                                  range |        1.01 |   ops/s |
|                                                 Max Throughput |                                                  range |        1.01 |   ops/s |
|                                        50th percentile latency |                                                  range |     13.7066 |      ms |
|                                        90th percentile latency |                                                  range |     16.1937 |      ms |
|                                        99th percentile latency |                                                  range |     19.3377 |      ms |
|                                      99.9th percentile latency |                                                  range |             |         |
|                                     99.99th percentile latency |                                                  range |             |         |
|                                       100th percentile latency |                                                  range |     20.4043 |      ms |
|                                   50th percentile service time |                                                  range |     11.9024 |      ms |
|                                   90th percentile service time |                                                  range |      14.559 |      ms |
|                                   99th percentile service time |                                                  range |     17.4504 |      ms |
|                                 99.9th percentile service time |                                                  range |             |         |
|                                99.99th percentile service time |                                                  range |             |         |
|                                  100th percentile service time |                                                  range |     18.5184 |      ms |
|                                                     error rate |                                                  range |           0 |       % |
|                                                 Min Throughput |                                          200s-in-range |       32.81 |   ops/s |
|                                                Mean Throughput |                                          200s-in-range |       32.82 |   ops/s |
|                                              Median Throughput |                                          200s-in-range |       32.82 |   ops/s |
|                                                 Max Throughput |                                          200s-in-range |       32.83 |   ops/s |
|                                        50th percentile latency |                                          200s-in-range |     8.82019 |      ms |
|                                        90th percentile latency |                                          200s-in-range |     12.5052 |      ms |
|                                        99th percentile latency |                                          200s-in-range |     15.0411 |      ms |
|                                      99.9th percentile latency |                                          200s-in-range |             |         |
|                                     99.99th percentile latency |                                          200s-in-range |             |         |
|                                       100th percentile latency |                                          200s-in-range |     15.5218 |      ms |
|                                   50th percentile service time |                                          200s-in-range |     7.83755 |      ms |
|                                   90th percentile service time |                                          200s-in-range |     11.1852 |      ms |
|                                   99th percentile service time |                                          200s-in-range |     14.2989 |      ms |
|                                 99.9th percentile service time |                                          200s-in-range |             |         |
|                                99.99th percentile service time |                                          200s-in-range |             |         |
|                                  100th percentile service time |                                          200s-in-range |      15.207 |      ms |
|                                                     error rate |                                          200s-in-range |           0 |       % |
|                                                 Min Throughput |                                          400s-in-range |       49.95 |   ops/s |
|                                                Mean Throughput |                                          400s-in-range |       49.96 |   ops/s |
|                                              Median Throughput |                                          400s-in-range |       49.96 |   ops/s |
|                                                 Max Throughput |                                          400s-in-range |       49.96 |   ops/s |
|                                        50th percentile latency |                                          400s-in-range |     6.44957 |      ms |
|                                        90th percentile latency |                                          400s-in-range |     7.65983 |      ms |
|                                        99th percentile latency |                                          400s-in-range |     9.19059 |      ms |
|                                      99.9th percentile latency |                                          400s-in-range |             |         |
|                                     99.99th percentile latency |                                          400s-in-range |             |         |
|                                       100th percentile latency |                                          400s-in-range |     9.90542 |      ms |
|                                   50th percentile service time |                                          400s-in-range |     5.25072 |      ms |
|                                   90th percentile service time |                                          400s-in-range |     6.48652 |      ms |
|                                   99th percentile service time |                                          400s-in-range |     8.22346 |      ms |
|                                 99.9th percentile service time |                                          400s-in-range |             |         |
|                                99.99th percentile service time |                                          400s-in-range |             |         |
|                                  100th percentile service time |                                          400s-in-range |     8.75973 |      ms |
|                                                     error rate |                                          400s-in-range |           0 |       % |
|                                                 Min Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                Mean Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                              Median Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                                 Max Throughput |                                             hourly_agg |         0.2 |   ops/s |
|                                        50th percentile latency |                                             hourly_agg |     3509.57 |      ms |
|                                        90th percentile latency |                                             hourly_agg |     4450.17 |      ms |
|                                        99th percentile latency |                                             hourly_agg |     4518.42 |      ms |
|                                      99.9th percentile latency |                                             hourly_agg |             |         |
|                                     99.99th percentile latency |                                             hourly_agg |             |         |
|                                       100th percentile latency |                                             hourly_agg |     4559.32 |      ms |
|                                   50th percentile service time |                                             hourly_agg |     3507.06 |      ms |
|                                   90th percentile service time |                                             hourly_agg |     4448.16 |      ms |
|                                   99th percentile service time |                                             hourly_agg |     4515.82 |      ms |
|                                 99.9th percentile service time |                                             hourly_agg |             |         |
|                                99.99th percentile service time |                                             hourly_agg |             |         |
|                                  100th percentile service time |                                             hourly_agg |     4558.32 |      ms |
|                                                     error rate |                                             hourly_agg |           0 |       % |
|                                                 Min Throughput |                                                 scroll |       24.93 | pages/s |
|                                                Mean Throughput |                                                 scroll |       24.96 | pages/s |
|                                              Median Throughput |                                                 scroll |       24.96 | pages/s |
|                                                 Max Throughput |                                                 scroll |       24.98 | pages/s |
|                                        50th percentile latency |                                                 scroll |     559.314 |      ms |
|                                        90th percentile latency |                                                 scroll |     619.081 |      ms |
|                                        99th percentile latency |                                                 scroll |     638.354 |      ms |
|                                      99.9th percentile latency |                                                 scroll |             |         |
|                                     99.99th percentile latency |                                                 scroll |             |         |
|                                       100th percentile latency |                                                 scroll |     667.492 |      ms |
|                                   50th percentile service time |                                                 scroll |     557.775 |      ms |
|                                   90th percentile service time |                                                 scroll |     617.446 |      ms |
|                                   99th percentile service time |                                                 scroll |     636.889 |      ms |
|                                 99.9th percentile service time |                                                 scroll |             |         |
|                                99.99th percentile service time |                                                 scroll |             |         |
|                                  100th percentile service time |                                                 scroll |     666.419 |      ms |
|                                                     error rate |                                                 scroll |           0 |       % |
|                                                 Min Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                    desc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                    desc_sort_timestamp |     161.967 |      ms |
|                                        90th percentile latency |                                    desc_sort_timestamp |      204.78 |      ms |
|                                        99th percentile latency |                                    desc_sort_timestamp |     231.204 |      ms |
|                                      99.9th percentile latency |                                    desc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                    desc_sort_timestamp |             |         |
|                                       100th percentile latency |                                    desc_sort_timestamp |     231.245 |      ms |
|                                   50th percentile service time |                                    desc_sort_timestamp |     159.094 |      ms |
|                                   90th percentile service time |                                    desc_sort_timestamp |     201.955 |      ms |
|                                   99th percentile service time |                                    desc_sort_timestamp |     227.752 |      ms |
|                                 99.9th percentile service time |                                    desc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                    desc_sort_timestamp |             |         |
|                                  100th percentile service time |                                    desc_sort_timestamp |      228.07 |      ms |
|                                                     error rate |                                    desc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                              Median Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                                 Max Throughput |                                     asc_sort_timestamp |         0.5 |   ops/s |
|                                        50th percentile latency |                                     asc_sort_timestamp |     13.4628 |      ms |
|                                        90th percentile latency |                                     asc_sort_timestamp |     16.2605 |      ms |
|                                        99th percentile latency |                                     asc_sort_timestamp |     18.8523 |      ms |
|                                      99.9th percentile latency |                                     asc_sort_timestamp |             |         |
|                                     99.99th percentile latency |                                     asc_sort_timestamp |             |         |
|                                       100th percentile latency |                                     asc_sort_timestamp |     20.5777 |      ms |
|                                   50th percentile service time |                                     asc_sort_timestamp |     11.3385 |      ms |
|                                   90th percentile service time |                                     asc_sort_timestamp |     13.8649 |      ms |
|                                   99th percentile service time |                                     asc_sort_timestamp |     17.5974 |      ms |
|                                 99.9th percentile service time |                                     asc_sort_timestamp |             |         |
|                                99.99th percentile service time |                                     asc_sort_timestamp |             |         |
|                                  100th percentile service time |                                     asc_sort_timestamp |     17.7414 |      ms |
|                                                     error rate |                                     asc_sort_timestamp |           0 |       % |
|                                                 Min Throughput |                         desc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                         desc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                         desc_sort_with_after_timestamp |        0.55 |   ops/s |
|                                        50th percentile latency |                         desc_sort_with_after_timestamp |      86.291 |      ms |
|                                        90th percentile latency |                         desc_sort_with_after_timestamp |     111.003 |      ms |
|                                        99th percentile latency |                         desc_sort_with_after_timestamp |     136.398 |      ms |
|                                      99.9th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                         desc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                         desc_sort_with_after_timestamp |     136.749 |      ms |
|                                   50th percentile service time |                         desc_sort_with_after_timestamp |     83.8102 |      ms |
|                                   90th percentile service time |                         desc_sort_with_after_timestamp |     107.626 |      ms |
|                                   99th percentile service time |                         desc_sort_with_after_timestamp |     133.658 |      ms |
|                                 99.9th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                         desc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                         desc_sort_with_after_timestamp |     134.448 |      ms |
|                                                     error rate |                         desc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                          asc_sort_with_after_timestamp |         0.5 |   ops/s |
|                                                Mean Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                              Median Throughput |                          asc_sort_with_after_timestamp |        0.51 |   ops/s |
|                                                 Max Throughput |                          asc_sort_with_after_timestamp |        0.55 |   ops/s |
|                                        50th percentile latency |                          asc_sort_with_after_timestamp |     65.4372 |      ms |
|                                        90th percentile latency |                          asc_sort_with_after_timestamp |     83.6314 |      ms |
|                                        99th percentile latency |                          asc_sort_with_after_timestamp |     97.1459 |      ms |
|                                      99.9th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                     99.99th percentile latency |                          asc_sort_with_after_timestamp |             |         |
|                                       100th percentile latency |                          asc_sort_with_after_timestamp |     111.679 |      ms |
|                                   50th percentile service time |                          asc_sort_with_after_timestamp |     62.8007 |      ms |
|                                   90th percentile service time |                          asc_sort_with_after_timestamp |      80.695 |      ms |
|                                   99th percentile service time |                          asc_sort_with_after_timestamp |     94.5173 |      ms |
|                                 99.9th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                99.99th percentile service time |                          asc_sort_with_after_timestamp |             |         |
|                                  100th percentile service time |                          asc_sort_with_after_timestamp |     109.836 |      ms |
|                                                     error rate |                          asc_sort_with_after_timestamp |           0 |       % |
|                                                 Min Throughput |                         wait-until-merges-1-seg-finish |        46.3 |   ops/s |
|                                                Mean Throughput |                         wait-until-merges-1-seg-finish |        46.3 |   ops/s |
|                                              Median Throughput |                         wait-until-merges-1-seg-finish |        46.3 |   ops/s |
|                                                 Max Throughput |                         wait-until-merges-1-seg-finish |        46.3 |   ops/s |
|                                        50th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        90th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                        99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                      99.9th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                     99.99th percentile latency |                         wait-until-merges-1-seg-finish |             |         |
|                                       100th percentile latency |                         wait-until-merges-1-seg-finish |     20.9963 |      ms |
|                                   50th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   90th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                   99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                 99.9th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                99.99th percentile service time |                         wait-until-merges-1-seg-finish |             |         |
|                                  100th percentile service time |                         wait-until-merges-1-seg-finish |     20.9963 |      ms |
|                                                     error rate |                         wait-until-merges-1-seg-finish |           0 |       % |
|                                                 Min Throughput |            desc-sort-timestamp-after-force-merge-1-seg |        1.99 |   ops/s |
|                                                Mean Throughput |            desc-sort-timestamp-after-force-merge-1-seg |        1.99 |   ops/s |
|                                              Median Throughput |            desc-sort-timestamp-after-force-merge-1-seg |        1.99 |   ops/s |
|                                                 Max Throughput |            desc-sort-timestamp-after-force-merge-1-seg |        1.99 |   ops/s |
|                                        50th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     152.119 |      ms |
|                                        90th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     209.974 |      ms |
|                                        99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     213.835 |      ms |
|                                      99.9th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |            desc-sort-timestamp-after-force-merge-1-seg |     214.403 |      ms |
|                                   50th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     150.703 |      ms |
|                                   90th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     207.992 |      ms |
|                                   99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     213.048 |      ms |
|                                 99.9th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |            desc-sort-timestamp-after-force-merge-1-seg |     213.643 |      ms |
|                                                     error rate |            desc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                Mean Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                              Median Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                                 Max Throughput |             asc-sort-timestamp-after-force-merge-1-seg |        2.01 |   ops/s |
|                                        50th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     10.6566 |      ms |
|                                        90th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     15.4564 |      ms |
|                                        99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |     20.5502 |      ms |
|                                      99.9th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |             asc-sort-timestamp-after-force-merge-1-seg |      22.716 |      ms |
|                                   50th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     9.30599 |      ms |
|                                   90th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     14.0236 |      ms |
|                                   99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     19.3795 |      ms |
|                                 99.9th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |             asc-sort-timestamp-after-force-merge-1-seg |     21.3379 |      ms |
|                                                     error rate |             asc-sort-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput | desc-sort-with-after-timestamp-after-force-merge-1-seg |        0.55 |   ops/s |
|                                        50th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     112.291 |      ms |
|                                        90th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     135.875 |      ms |
|                                        99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     146.156 |      ms |
|                                      99.9th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency | desc-sort-with-after-timestamp-after-force-merge-1-seg |     154.858 |      ms |
|                                   50th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     109.708 |      ms |
|                                   90th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     133.451 |      ms |
|                                   99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     143.804 |      ms |
|                                 99.9th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time | desc-sort-with-after-timestamp-after-force-merge-1-seg |     151.782 |      ms |
|                                                     error rate | desc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |
|                                                 Min Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |         0.5 |   ops/s |
|                                                Mean Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                              Median Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.51 |   ops/s |
|                                                 Max Throughput |  asc-sort-with-after-timestamp-after-force-merge-1-seg |        0.54 |   ops/s |
|                                        50th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     121.301 |      ms |
|                                        90th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     170.563 |      ms |
|                                        99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |      173.07 |      ms |
|                                      99.9th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                     99.99th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                       100th percentile latency |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     174.864 |      ms |
|                                   50th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     118.575 |      ms |
|                                   90th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     168.367 |      ms |
|                                   99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     170.682 |      ms |
|                                 99.9th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                99.99th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |             |         |
|                                  100th percentile service time |  asc-sort-with-after-timestamp-after-force-merge-1-seg |     171.801 |      ms |
|                                                     error rate |  asc-sort-with-after-timestamp-after-force-merge-1-seg |           0 |       % |

[WARNING] Error rate is 0.03 for operation 'index-append'. Please check the logs.

----------------------------------
[INFO] SUCCESS (took 7686 seconds)
----------------------------------

Metadata

Metadata

Assignees

No one assigned

    Labels

    Storage:DurabilityIssues and PRs related to the durability frameworkdiscussIssues intended to help drive brainstorming and decision makingenhancementEnhancement or improvement to existing feature or requestv2.10.0

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions