diff --git a/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt b/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt index 4bd8eaf012422..3c1b5af0d5986 100644 --- a/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt +++ b/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt @@ -2,121 +2,121 @@ SQL Single Numeric Column Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2111 2136 36 7.5 134.2 1.0X +Sum 2689 2694 7 5.8 170.9 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2140 2150 14 7.3 136.1 1.0X +Sum 2741 2759 26 5.7 174.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2281 2297 23 6.9 145.0 1.0X +Sum 2736 2748 17 5.7 173.9 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2635 2681 65 6.0 167.5 1.0X +Sum 3305 3317 17 4.8 210.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2095 2098 5 7.5 133.2 1.0X +Sum 2904 2952 68 5.4 184.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2340 2360 28 6.7 148.8 1.0X +Sum 3090 3093 4 5.1 196.5 1.0X ================================================================================================ Int and String Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of columns 3909 3940 45 2.7 372.8 1.0X +Sum of columns 5351 5365 20 2.0 510.3 1.0X ================================================================================================ Partitioned Table Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column 2628 2646 26 6.0 167.1 1.0X -Partition column 2399 2406 9 6.6 152.5 1.1X -Both columns 2801 2815 20 5.6 178.1 0.9X +Data column 3278 3288 14 4.8 208.4 1.0X +Partition column 3149 3193 62 5.0 200.2 1.0X +Both columns 3198 3204 7 4.9 203.4 1.0X ================================================================================================ Repeated String Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 2746 2754 11 3.8 261.9 1.0X +Sum of string length 3435 3438 5 3.1 327.6 1.0X ================================================================================================ String with Nulls Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 4715 4742 38 2.2 449.7 1.0X +Sum of string length 5634 5650 23 1.9 537.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 3927 3942 20 2.7 374.5 1.0X +Sum of string length 4725 4752 39 2.2 450.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 2753 2757 6 3.8 262.5 1.0X +Sum of string length 3550 3566 23 3.0 338.6 1.0X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 4326 4340 20 0.2 4125.7 1.0X +Sum of single column 5271 5279 11 0.2 5027.0 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 8559 8569 15 0.1 8162.1 1.0X +Sum of single column 10393 10516 174 0.1 9911.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 13200 13328 181 0.1 12588.4 1.0X +Sum of single column 15330 15343 19 0.1 14619.6 1.0X diff --git a/external/avro/benchmarks/AvroReadBenchmark-results.txt b/external/avro/benchmarks/AvroReadBenchmark-results.txt index ee2fd3f614f56..0ab611a0f9a29 100644 --- a/external/avro/benchmarks/AvroReadBenchmark-results.txt +++ b/external/avro/benchmarks/AvroReadBenchmark-results.txt @@ -2,121 +2,121 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2201 2268 96 7.1 139.9 1.0X +Sum 3049 3071 32 5.2 193.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2152 2159 11 7.3 136.8 1.0X +Sum 2982 2992 13 5.3 189.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2171 2185 19 7.2 138.1 1.0X +Sum 2984 2989 7 5.3 189.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2685 2700 22 5.9 170.7 1.0X +Sum 3262 3353 128 4.8 207.4 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2323 2324 1 6.8 147.7 1.0X +Sum 2716 2723 10 5.8 172.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2385 2400 22 6.6 151.6 1.0X +Sum 2868 2870 3 5.5 182.4 1.0X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of columns 3842 3851 13 2.7 366.4 1.0X +Sum of columns 4714 4739 35 2.2 449.6 1.0X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column 2666 2670 6 5.9 169.5 1.0X -Partition column 2461 2473 17 6.4 156.5 1.1X -Both columns 2626 2638 17 6.0 166.9 1.0X +Data column 3257 3286 41 4.8 207.1 1.0X +Partition column 3258 3277 27 4.8 207.2 1.0X +Both columns 3399 3405 9 4.6 216.1 1.0X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 2681 2685 5 3.9 255.7 1.0X +Sum of string length 3292 3316 33 3.2 314.0 1.0X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 4337 4346 12 2.4 413.6 1.0X +Sum of string length 5450 5456 9 1.9 519.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 3579 3617 53 2.9 341.3 1.0X +Sum of string length 4410 4435 35 2.4 420.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 2529 2542 18 4.1 241.2 1.0X +Sum of string length 3074 3122 68 3.4 293.2 1.0X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 3585 3589 6 0.3 3418.7 1.0X +Sum of single column 5120 5136 23 0.2 4882.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 6959 7013 77 0.2 6636.7 1.0X +Sum of single column 9952 10002 71 0.1 9490.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 10475 10530 78 0.1 9989.7 1.0X +Sum of single column 14973 14978 7 0.1 14279.8 1.0X diff --git a/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt b/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt index b82050743f4e1..baa237d3142d8 100644 --- a/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt @@ -2,142 +2,142 @@ aggregate without grouping ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -agg w/o group wholestage off 49910 50080 241 42.0 23.8 1.0X -agg w/o group wholestage on 810 816 5 2587.9 0.4 61.6X +agg w/o group wholestage off 59499 62969 2375 35.2 28.4 1.0X +agg w/o group wholestage on 890 902 10 2357.2 0.4 66.9X ================================================================================================ stat functions ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -stddev wholestage off 6817 6902 120 15.4 65.0 1.0X -stddev wholestage on 969 973 4 108.2 9.2 7.0X +stddev wholestage off 8702 8870 237 12.0 83.0 1.0X +stddev wholestage on 1307 1314 9 80.2 12.5 6.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -kurtosis wholestage off 32952 32953 1 3.2 314.3 1.0X -kurtosis wholestage on 1490 1492 2 70.4 14.2 22.1X +kurtosis wholestage off 42656 42797 198 2.5 406.8 1.0X +kurtosis wholestage on 1440 1466 32 72.8 13.7 29.6X ================================================================================================ aggregate with linear keys ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 8188 8250 88 10.2 97.6 1.0X -codegen = T hashmap = F 5435 5438 4 15.4 64.8 1.5X -codegen = T hashmap = T 1002 1030 50 83.7 11.9 8.2X +codegen = F 10963 11035 101 7.7 130.7 1.0X +codegen = T hashmap = F 6852 7080 207 12.2 81.7 1.6X +codegen = T hashmap = T 1377 1421 43 60.9 16.4 8.0X ================================================================================================ aggregate with randomized keys ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 8475 8542 95 9.9 101.0 1.0X -codegen = T hashmap = F 5487 5520 48 15.3 65.4 1.5X -codegen = T hashmap = T 1884 1938 64 44.5 22.5 4.5X +codegen = F 12240 12296 80 6.9 145.9 1.0X +codegen = T hashmap = F 8318 8376 87 10.1 99.2 1.5X +codegen = T hashmap = T 2551 2617 80 32.9 30.4 4.8X ================================================================================================ aggregate with string key ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 3623 3671 68 5.8 172.8 1.0X -codegen = T hashmap = F 2188 2235 77 9.6 104.4 1.7X -codegen = T hashmap = T 1190 1212 25 17.6 56.8 3.0X +codegen = F 4442 4504 88 4.7 211.8 1.0X +codegen = T hashmap = F 2685 2778 95 7.8 128.0 1.7X +codegen = T hashmap = T 1181 1203 15 17.8 56.3 3.8X ================================================================================================ aggregate with decimal key ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 2827 2834 10 7.4 134.8 1.0X -codegen = T hashmap = F 1775 1778 3 11.8 84.7 1.6X -codegen = T hashmap = T 531 548 23 39.5 25.3 5.3X +codegen = F 3487 3534 66 6.0 166.3 1.0X +codegen = T hashmap = F 2239 2353 161 9.4 106.8 1.6X +codegen = T hashmap = T 664 693 26 31.6 31.7 5.3X ================================================================================================ aggregate with multiple key types ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 5838 5853 20 3.6 278.4 1.0X -codegen = T hashmap = F 3184 3202 25 6.6 151.8 1.8X -codegen = T hashmap = T 2417 2470 76 8.7 115.2 2.4X +codegen = F 6414 6475 86 3.3 305.9 1.0X +codegen = T hashmap = F 3776 3800 34 5.6 180.1 1.7X +codegen = T hashmap = T 2824 2852 40 7.4 134.7 2.3X ================================================================================================ max function bytecode size of wholestagecodegen ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 493 501 9 1.3 752.3 1.0X -codegen = T hugeMethodLimit = 10000 284 292 17 2.3 433.5 1.7X -codegen = T hugeMethodLimit = 1500 281 287 13 2.3 428.1 1.8X +codegen = F 654 696 36 1.0 998.6 1.0X +codegen = T hugeMethodLimit = 10000 378 405 24 1.7 577.1 1.7X +codegen = T hugeMethodLimit = 1500 383 403 22 1.7 584.3 1.7X ================================================================================================ cube ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cube wholestage off 2576 2593 23 2.0 491.4 1.0X -cube wholestage on 1199 1217 22 4.4 228.7 2.1X +cube wholestage off 3443 3444 1 1.5 656.7 1.0X +cube wholestage on 1797 1815 20 2.9 342.7 1.9X ================================================================================================ hash and BytesToBytesMap ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeRowhash 264 265 0 79.3 12.6 1.0X -murmur3 hash 112 112 0 187.5 5.3 2.4X -fast hash 68 68 0 309.4 3.2 3.9X -arrayEqual 165 165 0 126.8 7.9 1.6X -Java HashMap (Long) 138 141 6 151.8 6.6 1.9X -Java HashMap (two ints) 115 118 6 182.3 5.5 2.3X -Java HashMap (UnsafeRow) 717 719 1 29.2 34.2 0.4X -LongToUnsafeRowMap (opt=false) 442 443 1 47.5 21.1 0.6X -LongToUnsafeRowMap (opt=true) 88 88 0 237.9 4.2 3.0X -BytesToBytesMap (off Heap) 900 900 1 23.3 42.9 0.3X -BytesToBytesMap (on Heap) 880 882 2 23.8 41.9 0.3X -Aggregate HashMap 53 53 0 398.2 2.5 5.0X +UnsafeRowhash 313 314 2 67.1 14.9 1.0X +murmur3 hash 144 145 2 145.9 6.9 2.2X +fast hash 70 72 5 301.5 3.3 4.5X +arrayEqual 189 190 0 111.0 9.0 1.7X +Java HashMap (Long) 129 132 4 162.4 6.2 2.4X +Java HashMap (two ints) 148 154 7 142.0 7.0 2.1X +Java HashMap (UnsafeRow) 839 840 1 25.0 40.0 0.4X +LongToUnsafeRowMap (opt=false) 462 464 1 45.4 22.0 0.7X +LongToUnsafeRowMap (opt=true) 108 108 1 194.2 5.2 2.9X +BytesToBytesMap (off Heap) 1027 1029 2 20.4 49.0 0.3X +BytesToBytesMap (on Heap) 999 1001 3 21.0 47.6 0.3X +Aggregate HashMap 44 44 0 477.8 2.1 7.1X diff --git a/sql/core/benchmarks/AggregateBenchmark-results.txt b/sql/core/benchmarks/AggregateBenchmark-results.txt index f0239c5e7392f..b1c2e9d6ae9fe 100644 --- a/sql/core/benchmarks/AggregateBenchmark-results.txt +++ b/sql/core/benchmarks/AggregateBenchmark-results.txt @@ -2,142 +2,142 @@ aggregate without grouping ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -agg w/o group wholestage off 39763 42107 NaN 52.7 19.0 1.0X -agg w/o group wholestage on 967 970 3 2168.7 0.5 41.1X +agg w/o group wholestage off 49902 52257 NaN 42.0 23.8 1.0X +agg w/o group wholestage on 1162 1171 10 1805.2 0.6 43.0X ================================================================================================ stat functions ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -stddev wholestage off 6232 6243 15 16.8 59.4 1.0X -stddev wholestage on 957 962 6 109.6 9.1 6.5X +stddev wholestage off 8203 8243 56 12.8 78.2 1.0X +stddev wholestage on 1287 1303 10 81.5 12.3 6.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -kurtosis wholestage off 31603 31606 5 3.3 301.4 1.0X -kurtosis wholestage on 1078 1082 5 97.2 10.3 29.3X +kurtosis wholestage off 39557 39919 511 2.7 377.2 1.0X +kurtosis wholestage on 1398 1476 138 75.0 13.3 28.3X ================================================================================================ aggregate with linear keys ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 8236 8331 135 10.2 98.2 1.0X -codegen = T hashmap = F 5398 5445 41 15.5 64.4 1.5X -codegen = T hashmap = T 1066 1157 98 78.7 12.7 7.7X +codegen = F 11236 12182 1337 7.5 133.9 1.0X +codegen = T hashmap = F 7079 7337 250 11.9 84.4 1.6X +codegen = T hashmap = T 1278 1419 186 65.6 15.2 8.8X ================================================================================================ aggregate with randomized keys ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 8774 8779 8 9.6 104.6 1.0X -codegen = T hashmap = F 5402 5422 22 15.5 64.4 1.6X -codegen = T hashmap = T 1926 1970 79 43.6 23.0 4.6X +codegen = F 11629 11650 30 7.2 138.6 1.0X +codegen = T hashmap = F 7552 7747 169 11.1 90.0 1.5X +codegen = T hashmap = T 2414 2662 167 34.7 28.8 4.8X ================================================================================================ aggregate with string key ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 3727 3747 29 5.6 177.7 1.0X -codegen = T hashmap = F 3005 3013 12 7.0 143.3 1.2X -codegen = T hashmap = T 2197 2214 19 9.5 104.7 1.7X +codegen = F 4790 4904 162 4.4 228.4 1.0X +codegen = T hashmap = F 3439 3504 105 6.1 164.0 1.4X +codegen = T hashmap = T 2327 2365 39 9.0 111.0 2.1X ================================================================================================ aggregate with decimal key ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 2631 2640 13 8.0 125.5 1.0X -codegen = T hashmap = F 1734 1734 0 12.1 82.7 1.5X -codegen = T hashmap = T 464 470 9 45.2 22.1 5.7X +codegen = F 3260 3418 223 6.4 155.5 1.0X +codegen = T hashmap = F 2316 2325 14 9.1 110.4 1.4X +codegen = T hashmap = T 605 607 2 34.7 28.8 5.4X ================================================================================================ aggregate with multiple key types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 6008 6049 57 3.5 286.5 1.0X -codegen = T hashmap = F 3878 3898 28 5.4 184.9 1.5X -codegen = T hashmap = T 3320 3343 32 6.3 158.3 1.8X +codegen = F 7426 7473 67 2.8 354.1 1.0X +codegen = T hashmap = F 4685 4723 54 4.5 223.4 1.6X +codegen = T hashmap = T 3946 4005 83 5.3 188.2 1.9X ================================================================================================ max function bytecode size of wholestagecodegen ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 445 446 0 1.5 679.6 1.0X -codegen = T hugeMethodLimit = 10000 252 261 14 2.6 384.1 1.8X -codegen = T hugeMethodLimit = 1500 249 254 9 2.6 380.0 1.8X +codegen = F 628 672 49 1.0 958.4 1.0X +codegen = T hugeMethodLimit = 10000 357 373 12 1.8 545.3 1.8X +codegen = T hugeMethodLimit = 1500 344 356 7 1.9 525.6 1.8X ================================================================================================ cube ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cube wholestage off 2583 2693 154 2.0 492.7 1.0X -cube wholestage on 1261 1289 29 4.2 240.5 2.0X +cube wholestage off 3167 3266 140 1.7 604.1 1.0X +cube wholestage on 1549 1576 29 3.4 295.4 2.0X ================================================================================================ hash and BytesToBytesMap ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeRowhash 266 267 1 78.7 12.7 1.0X -murmur3 hash 116 116 0 180.8 5.5 2.3X -fast hash 68 68 0 309.4 3.2 3.9X -arrayEqual 144 144 0 145.7 6.9 1.9X -Java HashMap (Long) 129 130 2 162.9 6.1 2.1X -Java HashMap (two ints) 123 125 2 170.6 5.9 2.2X -Java HashMap (UnsafeRow) 741 744 2 28.3 35.3 0.4X -LongToUnsafeRowMap (opt=false) 475 476 1 44.2 22.6 0.6X -LongToUnsafeRowMap (opt=true) 99 99 0 212.9 4.7 2.7X -BytesToBytesMap (off Heap) 932 933 1 22.5 44.5 0.3X -BytesToBytesMap (on Heap) 921 924 2 22.8 43.9 0.3X -Aggregate HashMap 60 60 0 351.9 2.8 4.5X +UnsafeRowhash 326 328 2 64.3 15.5 1.0X +murmur3 hash 147 147 0 142.7 7.0 2.2X +fast hash 74 75 1 282.3 3.5 4.4X +arrayEqual 175 175 0 119.8 8.3 1.9X +Java HashMap (Long) 138 140 4 152.1 6.6 2.4X +Java HashMap (two ints) 148 154 7 141.7 7.1 2.2X +Java HashMap (UnsafeRow) 1043 1090 66 20.1 49.8 0.3X +LongToUnsafeRowMap (opt=false) 464 466 2 45.2 22.1 0.7X +LongToUnsafeRowMap (opt=true) 104 106 8 202.3 4.9 3.1X +BytesToBytesMap (off Heap) 1140 1149 12 18.4 54.4 0.3X +BytesToBytesMap (on Heap) 1002 1132 183 20.9 47.8 0.3X +Aggregate HashMap 74 74 0 281.9 3.5 4.4X diff --git a/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt b/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt index 2d2fc89028e4e..cb1e96a3df236 100644 --- a/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt @@ -2,23 +2,23 @@ ORC Write ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 16334 16469 191 6.1 163.3 1.0X -With bloom filter 19150 19156 8 5.2 191.5 0.9X +Without bloom filter 19554 20736 1672 5.1 195.5 1.0X +With bloom filter 22112 22203 129 4.5 221.1 0.9X ================================================================================================ ORC Read ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 1636 1647 16 61.1 16.4 1.0X -With bloom filter 988 1002 20 101.2 9.9 1.7X +Without bloom filter 1866 1879 19 53.6 18.7 1.0X +With bloom filter 1523 1544 29 65.6 15.2 1.2X diff --git a/sql/core/benchmarks/BloomFilterBenchmark-results.txt b/sql/core/benchmarks/BloomFilterBenchmark-results.txt index 3ca063ed5c7b5..ec629129559f4 100644 --- a/sql/core/benchmarks/BloomFilterBenchmark-results.txt +++ b/sql/core/benchmarks/BloomFilterBenchmark-results.txt @@ -2,23 +2,23 @@ ORC Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 15131 15140 13 6.6 151.3 1.0X -With bloom filter 17934 17952 25 5.6 179.3 0.8X +Without bloom filter 19110 19145 50 5.2 191.1 1.0X +With bloom filter 21890 21908 25 4.6 218.9 0.9X ================================================================================================ ORC Read ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 1238 1238 0 80.8 12.4 1.0X -With bloom filter 940 950 12 106.4 9.4 1.3X +Without bloom filter 1724 1746 30 58.0 17.2 1.0X +With bloom filter 1364 1376 17 73.3 13.6 1.3X diff --git a/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt b/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt index 9e7b59bba0c8a..2d24a273f7575 100644 --- a/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt @@ -2,58 +2,58 @@ Benchmark to measure CSV read/write performance ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -One quoted string 40922 40989 58 0.0 818445.4 1.0X +One quoted string 44297 44515 373 0.0 885948.7 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 1000 columns 130250 130731 715 0.0 130250.1 1.0X -Select 100 columns 40473 40572 99 0.0 40473.3 3.2X -Select one column 33028 33090 57 0.0 33028.2 3.9X -count() 7391 7405 12 0.1 7391.2 17.6X -Select 100 columns, one bad input field 47999 48058 79 0.0 47998.7 2.7X -Select 100 columns, corrupt record field 52099 52140 44 0.0 52099.5 2.5X +Select 1000 columns 196720 197783 1560 0.0 196719.8 1.0X +Select 100 columns 46691 46861 219 0.0 46691.4 4.2X +Select one column 36811 36922 111 0.0 36811.3 5.3X +count() 8520 8610 106 0.1 8520.5 23.1X +Select 100 columns, one bad input field 67914 67994 136 0.0 67914.0 2.9X +Select 100 columns, corrupt record field 77272 77445 214 0.0 77272.0 2.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns + count() 18537 18576 34 0.5 1853.7 1.0X -Select 1 column + count() 13534 13587 74 0.7 1353.4 1.4X -count() 5971 5993 20 1.7 597.1 3.1X +Select 10 columns + count() 25965 26054 103 0.4 2596.5 1.0X +Select 1 column + count() 18591 18666 91 0.5 1859.1 1.4X +count() 6102 6119 18 1.6 610.2 4.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 1207 1213 9 8.3 120.7 1.0X -to_csv(timestamp) 10510 11250 800 1.0 1051.0 0.1X -write timestamps to files 9626 9657 31 1.0 962.6 0.1X -Create a dataset of dates 1264 1280 22 7.9 126.4 1.0X -to_csv(date) 7657 7674 23 1.3 765.7 0.2X -write dates to files 6259 6316 52 1.6 625.9 0.2X +Create a dataset of timestamps 2142 2161 17 4.7 214.2 1.0X +to_csv(timestamp) 14744 14950 182 0.7 1474.4 0.1X +write timestamps to files 12078 12202 175 0.8 1207.8 0.2X +Create a dataset of dates 2275 2291 18 4.4 227.5 0.9X +to_csv(date) 11407 11464 51 0.9 1140.7 0.2X +write dates to files 7638 7702 90 1.3 763.8 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 2255 2262 7 4.4 225.5 1.0X -read timestamps from files 29852 29915 56 0.3 2985.2 0.1X -infer timestamps from files 57109 57282 176 0.2 5710.9 0.0X -read date text from files 2148 2168 18 4.7 214.8 1.0X -read date from files 23437 23632 170 0.4 2343.7 0.1X -infer date from files 23101 23184 99 0.4 2310.1 0.1X -timestamp strings 2188 2192 4 4.6 218.8 1.0X -parse timestamps from Dataset[String] 32733 32847 100 0.3 3273.3 0.1X -infer timestamps from Dataset[String] 60775 60869 98 0.2 6077.5 0.0X -date strings 2528 2529 2 4.0 252.8 0.9X -parse dates from Dataset[String] 25947 25986 40 0.4 2594.7 0.1X -from_csv(timestamp) 30914 31021 157 0.3 3091.4 0.1X -from_csv(date) 24670 24904 272 0.4 2467.0 0.1X +read timestamp text from files 2578 2590 10 3.9 257.8 1.0X +read timestamps from files 60103 60694 512 0.2 6010.3 0.0X +infer timestamps from files 107871 108268 351 0.1 10787.1 0.0X +read date text from files 2306 2310 4 4.3 230.6 1.1X +read date from files 47415 47657 367 0.2 4741.5 0.1X +infer date from files 35261 35447 164 0.3 3526.1 0.1X +timestamp strings 3045 3056 11 3.3 304.5 0.8X +parse timestamps from Dataset[String] 62221 63173 849 0.2 6222.1 0.0X +infer timestamps from Dataset[String] 118838 119629 697 0.1 11883.8 0.0X +date strings 3459 3481 19 2.9 345.9 0.7X +parse dates from Dataset[String] 51026 51447 503 0.2 5102.6 0.1X +from_csv(timestamp) 60738 61818 936 0.2 6073.8 0.0X +from_csv(date) 46012 46278 370 0.2 4601.2 0.1X diff --git a/sql/core/benchmarks/CSVBenchmark-results.txt b/sql/core/benchmarks/CSVBenchmark-results.txt index a73dcb169fa8c..0777549efc5f5 100644 --- a/sql/core/benchmarks/CSVBenchmark-results.txt +++ b/sql/core/benchmarks/CSVBenchmark-results.txt @@ -2,58 +2,58 @@ Benchmark to measure CSV read/write performance ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -One quoted string 38738 38801 84 0.0 774761.7 1.0X +One quoted string 51602 51659 59 0.0 1032039.4 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 1000 columns 111186 113031 1649 0.0 111185.7 1.0X -Select 100 columns 34218 34613 389 0.0 34218.2 3.2X -Select one column 28630 28713 72 0.0 28629.8 3.9X -count() 8328 8365 32 0.1 8328.2 13.4X -Select 100 columns, one bad input field 39616 40140 474 0.0 39615.9 2.8X -Select 100 columns, corrupt record field 48388 48449 57 0.0 48388.3 2.3X +Select 1000 columns 191926 192879 1615 0.0 191925.6 1.0X +Select 100 columns 46766 46846 69 0.0 46766.1 4.1X +Select one column 35877 35930 83 0.0 35876.8 5.3X +count() 11186 11262 65 0.1 11186.0 17.2X +Select 100 columns, one bad input field 59943 60107 232 0.0 59943.0 3.2X +Select 100 columns, corrupt record field 73062 73406 479 0.0 73062.2 2.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns + count() 15945 15956 15 0.6 1594.5 1.0X -Select 1 column + count() 11545 11578 30 0.9 1154.5 1.4X -count() 5311 5419 93 1.9 531.1 3.0X +Select 10 columns + count() 22389 22447 87 0.4 2238.9 1.0X +Select 1 column + count() 14844 14890 43 0.7 1484.4 1.5X +count() 5519 5538 18 1.8 551.9 4.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 1056 1070 14 9.5 105.6 1.0X -to_csv(timestamp) 10256 10834 866 1.0 1025.6 0.1X -write timestamps to files 8610 8638 25 1.2 861.0 0.1X -Create a dataset of dates 1211 1244 38 8.3 121.1 0.9X -to_csv(date) 7318 7327 8 1.4 731.8 0.1X -write dates to files 5360 5368 13 1.9 536.0 0.2X +Create a dataset of timestamps 1949 1977 25 5.1 194.9 1.0X +to_csv(timestamp) 14944 15702 714 0.7 1494.4 0.1X +write timestamps to files 12983 12998 14 0.8 1298.3 0.2X +Create a dataset of dates 2156 2164 7 4.6 215.6 0.9X +to_csv(date) 9675 9709 41 1.0 967.5 0.2X +write dates to files 7880 7897 15 1.3 788.0 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 1949 1966 27 5.1 194.9 1.0X -read timestamps from files 25611 25625 14 0.4 2561.1 0.1X -infer timestamps from files 47531 48295 678 0.2 4753.1 0.0X -read date text from files 1820 1832 11 5.5 182.0 1.1X -read date from files 20238 20258 19 0.5 2023.8 0.1X -infer date from files 19929 19958 26 0.5 1992.9 0.1X -timestamp strings 2472 2481 8 4.0 247.2 0.8X -parse timestamps from Dataset[String] 29423 29571 149 0.3 2942.3 0.1X -infer timestamps from Dataset[String] 53800 53903 158 0.2 5380.0 0.0X -date strings 2704 2706 2 3.7 270.4 0.7X -parse dates from Dataset[String] 23411 23435 35 0.4 2341.1 0.1X -from_csv(timestamp) 26991 27038 44 0.4 2699.1 0.1X -from_csv(date) 22072 22110 37 0.5 2207.2 0.1X +read timestamp text from files 2235 2245 10 4.5 223.5 1.0X +read timestamps from files 54490 54690 283 0.2 5449.0 0.0X +infer timestamps from files 104501 104737 236 0.1 10450.1 0.0X +read date text from files 2035 2040 6 4.9 203.5 1.1X +read date from files 39650 39707 52 0.3 3965.0 0.1X +infer date from files 29235 29363 164 0.3 2923.5 0.1X +timestamp strings 3412 3426 18 2.9 341.2 0.7X +parse timestamps from Dataset[String] 66864 67804 981 0.1 6686.4 0.0X +infer timestamps from Dataset[String] 118780 119284 837 0.1 11878.0 0.0X +date strings 3730 3734 4 2.7 373.0 0.6X +parse dates from Dataset[String] 48728 49071 309 0.2 4872.8 0.0X +from_csv(timestamp) 62294 62493 260 0.2 6229.4 0.0X +from_csv(date) 44581 44665 117 0.2 4458.1 0.1X diff --git a/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt b/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt index 1417930499513..595f69c8e1407 100644 --- a/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt @@ -2,251 +2,251 @@ SQL Single Numeric Column Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 20515 20557 60 0.8 1304.3 1.0X -SQL Json 8335 8408 104 1.9 529.9 2.5X -SQL Parquet Vectorized 130 139 8 120.8 8.3 157.6X -SQL Parquet MR 1844 1953 153 8.5 117.3 11.1X -SQL ORC Vectorized 247 250 2 63.6 15.7 83.0X -SQL ORC MR 1521 1525 6 10.3 96.7 13.5X +SQL CSV 28338 28589 356 0.6 1801.7 1.0X +SQL Json 9273 9332 83 1.7 589.6 3.1X +SQL Parquet Vectorized 186 217 22 84.3 11.9 152.0X +SQL Parquet MR 1951 1972 29 8.1 124.1 14.5X +SQL ORC Vectorized 256 277 22 61.4 16.3 110.6X +SQL ORC MR 1627 1717 127 9.7 103.4 17.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 194 207 20 80.9 12.4 1.0X -ParquetReader Vectorized -> Row 91 92 1 172.5 5.8 2.1X +ParquetReader Vectorized 208 223 13 75.8 13.2 1.0X +ParquetReader Vectorized -> Row 96 97 1 164.1 6.1 2.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 21202 21223 30 0.7 1348.0 1.0X -SQL Json 8942 8948 9 1.8 568.5 2.4X -SQL Parquet Vectorized 167 169 2 94.4 10.6 127.3X -SQL Parquet MR 2063 2066 4 7.6 131.2 10.3X -SQL ORC Vectorized 279 282 2 56.3 17.8 75.9X -SQL ORC MR 1647 1657 14 9.5 104.7 12.9X +SQL CSV 28493 28516 33 0.6 1811.5 1.0X +SQL Json 10257 10291 47 1.5 652.1 2.8X +SQL Parquet Vectorized 215 233 14 73.2 13.7 132.5X +SQL Parquet MR 2384 2388 7 6.6 151.5 12.0X +SQL ORC Vectorized 298 307 7 52.8 18.9 95.6X +SQL ORC MR 1798 1814 22 8.7 114.3 15.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 241 245 4 65.3 15.3 1.0X -ParquetReader Vectorized -> Row 128 147 45 122.8 8.1 1.9X +ParquetReader Vectorized 286 293 6 54.9 18.2 1.0X +ParquetReader Vectorized -> Row 154 179 57 102.3 9.8 1.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 23776 23819 61 0.7 1511.6 1.0X -SQL Json 9446 9458 17 1.7 600.6 2.5X -SQL Parquet Vectorized 140 142 5 112.7 8.9 170.4X -SQL Parquet MR 2127 2184 81 7.4 135.2 11.2X -SQL ORC Vectorized 216 218 2 72.7 13.8 109.9X -SQL ORC MR 1718 1721 5 9.2 109.2 13.8X +SQL CSV 30821 30902 114 0.5 1959.5 1.0X +SQL Json 10935 10944 13 1.4 695.3 2.8X +SQL Parquet Vectorized 203 213 12 77.6 12.9 152.1X +SQL Parquet MR 2334 2351 24 6.7 148.4 13.2X +SQL ORC Vectorized 281 286 4 56.0 17.9 109.6X +SQL ORC MR 1943 2022 112 8.1 123.5 15.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 230 237 7 68.3 14.6 1.0X -ParquetReader Vectorized -> Row 234 236 3 67.3 14.9 1.0X +ParquetReader Vectorized 284 291 9 55.5 18.0 1.0X +ParquetReader Vectorized -> Row 277 281 6 56.8 17.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 29165 29227 88 0.5 1854.3 1.0X -SQL Json 11885 11921 51 1.3 755.6 2.5X -SQL Parquet Vectorized 208 231 40 75.7 13.2 140.4X -SQL Parquet MR 2608 2611 3 6.0 165.8 11.2X -SQL ORC Vectorized 331 335 3 47.6 21.0 88.2X -SQL ORC MR 1867 1906 56 8.4 118.7 15.6X +SQL CSV 38264 38306 60 0.4 2432.7 1.0X +SQL Json 14369 14371 3 1.1 913.6 2.7X +SQL Parquet Vectorized 313 319 6 50.3 19.9 122.3X +SQL Parquet MR 2581 2602 30 6.1 164.1 14.8X +SQL ORC Vectorized 423 432 9 37.2 26.9 90.4X +SQL ORC MR 2108 2142 49 7.5 134.0 18.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 309 313 4 50.8 19.7 1.0X -ParquetReader Vectorized -> Row 313 318 7 50.3 19.9 1.0X +ParquetReader Vectorized 401 409 8 39.2 25.5 1.0X +ParquetReader Vectorized -> Row 392 400 15 40.2 24.9 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 24091 24118 37 0.7 1531.7 1.0X -SQL Json 11468 11473 8 1.4 729.1 2.1X -SQL Parquet Vectorized 138 139 2 114.1 8.8 174.7X -SQL Parquet MR 2090 2097 9 7.5 132.9 11.5X -SQL ORC Vectorized 381 382 1 41.3 24.2 63.2X -SQL ORC MR 1890 1898 11 8.3 120.2 12.7X +SQL CSV 36276 36300 34 0.4 2306.4 1.0X +SQL Json 13691 14374 967 1.1 870.4 2.6X +SQL Parquet Vectorized 193 198 5 81.6 12.3 188.2X +SQL Parquet MR 2361 2389 40 6.7 150.1 15.4X +SQL ORC Vectorized 430 434 4 36.6 27.3 84.4X +SQL ORC MR 2037 2072 50 7.7 129.5 17.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 240 243 4 65.5 15.3 1.0X -ParquetReader Vectorized -> Row 243 245 3 64.7 15.5 1.0X +ParquetReader Vectorized 277 284 10 56.8 17.6 1.0X +ParquetReader Vectorized -> Row 274 276 4 57.5 17.4 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 29531 29589 82 0.5 1877.5 1.0X -SQL Json 15989 15999 14 1.0 1016.6 1.8X -SQL Parquet Vectorized 210 212 4 75.0 13.3 140.9X -SQL Parquet MR 2258 2285 39 7.0 143.5 13.1X -SQL ORC Vectorized 453 455 2 34.7 28.8 65.2X -SQL ORC MR 1921 1939 25 8.2 122.2 15.4X +SQL CSV 39757 39761 5 0.4 2527.7 1.0X +SQL Json 20049 20052 5 0.8 1274.7 2.0X +SQL Parquet Vectorized 310 318 10 50.7 19.7 128.3X +SQL Parquet MR 2535 2571 52 6.2 161.2 15.7X +SQL ORC Vectorized 537 543 8 29.3 34.1 74.1X +SQL ORC MR 2132 2161 41 7.4 135.6 18.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 316 339 47 49.8 20.1 1.0X -ParquetReader Vectorized -> Row 314 315 1 50.1 20.0 1.0X +ParquetReader Vectorized 390 394 5 40.3 24.8 1.0X +ParquetReader Vectorized -> Row 389 391 5 40.5 24.7 1.0X ================================================================================================ Int and String Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 20483 20517 48 0.5 1953.4 1.0X -SQL Json 11225 11226 2 0.9 1070.5 1.8X -SQL Parquet Vectorized 1993 1995 3 5.3 190.0 10.3X -SQL Parquet MR 4045 4081 51 2.6 385.8 5.1X -SQL ORC Vectorized 2333 2339 7 4.5 222.5 8.8X -SQL ORC MR 3909 3962 75 2.7 372.8 5.2X +SQL CSV 27215 27240 34 0.4 2595.5 1.0X +SQL Json 12713 12783 100 0.8 1212.4 2.1X +SQL Parquet Vectorized 2265 2269 5 4.6 216.0 12.0X +SQL Parquet MR 4477 4544 95 2.3 426.9 6.1X +SQL ORC Vectorized 2388 2404 23 4.4 227.7 11.4X +SQL ORC MR 4295 4305 15 2.4 409.6 6.3X ================================================================================================ Repeated String Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 13719 13734 21 0.8 1308.4 1.0X -SQL Json 6425 6433 12 1.6 612.7 2.1X -SQL Parquet Vectorized 643 646 2 16.3 61.3 21.4X -SQL Parquet MR 2003 2022 27 5.2 191.0 6.9X -SQL ORC Vectorized 525 529 4 20.0 50.1 26.1X -SQL ORC MR 1914 1925 16 5.5 182.5 7.2X +SQL CSV 17544 17580 51 0.6 1673.1 1.0X +SQL Json 8277 8328 71 1.3 789.4 2.1X +SQL Parquet Vectorized 674 682 7 15.6 64.3 26.0X +SQL Parquet MR 1960 1972 17 5.3 187.0 8.9X +SQL ORC Vectorized 551 558 11 19.0 52.6 31.8X +SQL ORC MR 2047 2052 6 5.1 195.2 8.6X ================================================================================================ Partitioned Table Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - CSV 29514 29516 3 0.5 1876.5 1.0X -Data column - Json 12352 12353 1 1.3 785.3 2.4X -Data column - Parquet Vectorized 227 230 2 69.2 14.4 129.9X -Data column - Parquet MR 2574 2606 44 6.1 163.7 11.5X -Data column - ORC Vectorized 345 349 4 45.6 21.9 85.6X -Data column - ORC MR 2080 2080 0 7.6 132.3 14.2X -Partition column - CSV 12092 12125 46 1.3 768.8 2.4X -Partition column - Json 9929 9952 33 1.6 631.3 3.0X -Partition column - Parquet Vectorized 67 69 2 235.0 4.3 441.0X -Partition column - Parquet MR 1242 1258 23 12.7 79.0 23.8X -Partition column - ORC Vectorized 67 69 2 233.8 4.3 438.8X -Partition column - ORC MR 1358 1364 8 11.6 86.4 21.7X -Both columns - CSV 29515 29560 63 0.5 1876.5 1.0X -Both columns - Json 13108 13112 6 1.2 833.4 2.3X -Both columns - Parquet Vectorized 267 270 4 58.9 17.0 110.6X -Both columns - Parquet MR 2678 2718 57 5.9 170.3 11.0X -Both columns - ORC Vectorized 513 515 3 30.7 32.6 57.5X -Both columns - ORC MR 2422 2425 4 6.5 154.0 12.2X +Data column - CSV 40273 40290 24 0.4 2560.5 1.0X +Data column - Json 14420 14440 28 1.1 916.8 2.8X +Data column - Parquet Vectorized 336 342 6 46.8 21.4 119.8X +Data column - Parquet MR 2651 2652 2 5.9 168.5 15.2X +Data column - ORC Vectorized 444 451 9 35.4 28.2 90.7X +Data column - ORC MR 2342 2356 20 6.7 148.9 17.2X +Partition column - CSV 11307 11310 4 1.4 718.9 3.6X +Partition column - Json 12105 12115 14 1.3 769.6 3.3X +Partition column - Parquet Vectorized 87 97 13 181.2 5.5 464.0X +Partition column - Parquet MR 1364 1368 7 11.5 86.7 29.5X +Partition column - ORC Vectorized 83 97 13 189.0 5.3 484.1X +Partition column - ORC MR 1424 1437 19 11.0 90.5 28.3X +Both columns - CSV 41896 42166 381 0.4 2663.7 1.0X +Both columns - Json 15852 15871 27 1.0 1007.8 2.5X +Both columns - Parquet Vectorized 379 383 5 41.5 24.1 106.2X +Both columns - Parquet MR 2889 2916 38 5.4 183.7 13.9X +Both columns - ORC Vectorized 581 582 2 27.1 36.9 69.3X +Both columns - ORC MR 2626 2641 22 6.0 166.9 15.3X ================================================================================================ String with Nulls Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 15361 15412 71 0.7 1465.0 1.0X -SQL Json 9085 9087 4 1.2 866.4 1.7X -SQL Parquet Vectorized 1238 1246 12 8.5 118.1 12.4X -SQL Parquet MR 3948 3960 16 2.7 376.5 3.9X -ParquetReader Vectorized 923 929 7 11.4 88.0 16.6X -SQL ORC Vectorized 1205 1207 3 8.7 114.9 12.7X -SQL ORC MR 3323 3331 12 3.2 316.9 4.6X +SQL CSV 20831 21141 439 0.5 1986.6 1.0X +SQL Json 11720 11721 1 0.9 1117.7 1.8X +SQL Parquet Vectorized 1470 1475 7 7.1 140.2 14.2X +SQL Parquet MR 3902 3902 0 2.7 372.1 5.3X +ParquetReader Vectorized 1074 1077 4 9.8 102.5 19.4X +SQL ORC Vectorized 1289 1334 64 8.1 122.9 16.2X +SQL ORC MR 3603 3612 13 2.9 343.6 5.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 15630 15653 33 0.7 1490.6 1.0X -SQL Json 7150 7153 5 1.5 681.8 2.2X -SQL Parquet Vectorized 1068 1074 9 9.8 101.9 14.6X -SQL Parquet MR 3021 3049 40 3.5 288.1 5.2X -ParquetReader Vectorized 962 967 5 10.9 91.8 16.2X -SQL ORC Vectorized 1240 1246 7 8.5 118.3 12.6X -SQL ORC MR 3027 3032 7 3.5 288.7 5.2X +SQL CSV 21850 21910 85 0.5 2083.8 1.0X +SQL Json 8651 8668 24 1.2 825.0 2.5X +SQL Parquet Vectorized 1079 1090 16 9.7 102.9 20.3X +SQL Parquet MR 2906 2925 27 3.6 277.1 7.5X +ParquetReader Vectorized 951 954 4 11.0 90.7 23.0X +SQL ORC Vectorized 1246 1250 5 8.4 118.8 17.5X +SQL ORC MR 3146 3162 22 3.3 300.1 6.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 14355 14419 91 0.7 1369.0 1.0X -SQL Json 4319 4330 15 2.4 411.9 3.3X -SQL Parquet Vectorized 225 226 2 46.7 21.4 63.9X -SQL Parquet MR 1927 1946 27 5.4 183.7 7.5X -ParquetReader Vectorized 246 247 1 42.6 23.5 58.3X -SQL ORC Vectorized 392 393 1 26.8 37.4 36.6X -SQL ORC MR 1643 1653 15 6.4 156.7 8.7X +SQL CSV 18993 19140 209 0.6 1811.3 1.0X +SQL Json 5467 5469 2 1.9 521.4 3.5X +SQL Parquet Vectorized 240 248 10 43.8 22.8 79.3X +SQL Parquet MR 1745 1753 12 6.0 166.4 10.9X +ParquetReader Vectorized 240 244 5 43.7 22.9 79.1X +SQL ORC Vectorized 496 500 4 21.1 47.3 38.3X +SQL ORC MR 1822 1827 8 5.8 173.7 10.4X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 2821 2829 11 0.4 2690.5 1.0X -SQL Json 3106 3111 7 0.3 2962.0 0.9X -SQL Parquet Vectorized 46 48 1 22.6 44.3 60.8X -SQL Parquet MR 209 213 3 5.0 199.0 13.5X -SQL ORC Vectorized 54 56 4 19.3 51.7 52.0X -SQL ORC MR 170 173 3 6.2 162.0 16.6X +SQL CSV 3907 3911 6 0.3 3726.3 1.0X +SQL Json 3755 3763 12 0.3 3581.2 1.0X +SQL Parquet Vectorized 68 71 6 15.4 64.8 57.5X +SQL Parquet MR 234 239 5 4.5 223.0 16.7X +SQL ORC Vectorized 74 77 5 14.2 70.4 52.9X +SQL ORC MR 203 204 2 5.2 193.3 19.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 6682 6696 19 0.2 6372.7 1.0X -SQL Json 12351 12493 201 0.1 11779.2 0.5X -SQL Parquet Vectorized 83 85 3 12.7 78.9 80.8X -SQL Parquet MR 248 250 2 4.2 236.4 27.0X -SQL ORC Vectorized 88 90 2 12.0 83.6 76.2X -SQL ORC MR 206 210 3 5.1 196.9 32.4X +SQL CSV 7909 7927 25 0.1 7542.9 1.0X +SQL Json 15014 15101 123 0.1 14318.8 0.5X +SQL Parquet Vectorized 105 128 22 10.0 100.0 75.4X +SQL Parquet MR 275 283 9 3.8 261.9 28.8X +SQL ORC Vectorized 104 116 9 10.1 98.9 76.3X +SQL ORC MR 234 245 12 4.5 223.0 33.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 11423 11430 9 0.1 10894.1 1.0X -SQL Json 23743 23784 57 0.0 22643.2 0.5X -SQL Parquet Vectorized 127 129 2 8.3 121.0 90.0X -SQL Parquet MR 294 299 6 3.6 280.3 38.9X -SQL ORC Vectorized 115 116 2 9.2 109.2 99.7X -SQL ORC MR 236 238 2 4.4 225.5 48.3X +SQL CSV 13033 13129 136 0.1 12429.1 1.0X +SQL Json 28298 29130 1176 0.0 26987.3 0.5X +SQL Parquet Vectorized 139 151 9 7.5 132.7 93.7X +SQL Parquet MR 314 322 7 3.3 299.5 41.5X +SQL ORC Vectorized 123 143 17 8.5 117.3 106.0X +SQL ORC MR 260 272 9 4.0 248.1 50.1X diff --git a/sql/core/benchmarks/DataSourceReadBenchmark-results.txt b/sql/core/benchmarks/DataSourceReadBenchmark-results.txt index 1e8324a3056ae..40e8dfc77c712 100644 --- a/sql/core/benchmarks/DataSourceReadBenchmark-results.txt +++ b/sql/core/benchmarks/DataSourceReadBenchmark-results.txt @@ -2,251 +2,251 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 18807 18894 123 0.8 1195.7 1.0X -SQL Json 6856 6884 39 2.3 435.9 2.7X -SQL Parquet Vectorized 117 122 7 134.7 7.4 161.1X -SQL Parquet MR 1609 1611 2 9.8 102.3 11.7X -SQL ORC Vectorized 229 231 1 68.8 14.5 82.3X -SQL ORC MR 1312 1313 1 12.0 83.4 14.3X +SQL CSV 24716 24743 38 0.6 1571.4 1.0X +SQL Json 9669 9686 25 1.6 614.7 2.6X +SQL Parquet Vectorized 172 193 21 91.2 11.0 143.4X +SQL Parquet MR 1929 1942 18 8.2 122.7 12.8X +SQL ORC Vectorized 247 266 19 63.6 15.7 99.9X +SQL ORC MR 1640 1660 29 9.6 104.3 15.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 179 181 3 88.0 11.4 1.0X -ParquetReader Vectorized -> Row 80 81 1 195.7 5.1 2.2X +ParquetReader Vectorized 197 200 4 79.9 12.5 1.0X +ParquetReader Vectorized -> Row 96 98 3 164.1 6.1 2.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 19569 19579 14 0.8 1244.1 1.0X -SQL Json 7432 7461 42 2.1 472.5 2.6X -SQL Parquet Vectorized 152 155 5 103.2 9.7 128.4X -SQL Parquet MR 1794 1796 2 8.8 114.1 10.9X -SQL ORC Vectorized 257 259 2 61.2 16.3 76.1X -SQL ORC MR 1480 1493 19 10.6 94.1 13.2X +SQL CSV 25320 25343 32 0.6 1609.8 1.0X +SQL Json 10460 10465 8 1.5 665.0 2.4X +SQL Parquet Vectorized 206 218 13 76.5 13.1 123.2X +SQL Parquet MR 2032 2036 6 7.7 129.2 12.5X +SQL ORC Vectorized 295 301 4 53.4 18.7 85.9X +SQL ORC MR 1867 1885 25 8.4 118.7 13.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 222 225 5 71.0 14.1 1.0X -ParquetReader Vectorized -> Row 199 202 5 79.0 12.7 1.1X +ParquetReader Vectorized 288 294 6 54.6 18.3 1.0X +ParquetReader Vectorized -> Row 252 254 4 62.3 16.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 20771 20815 63 0.8 1320.6 1.0X -SQL Json 8021 8040 27 2.0 510.0 2.6X -SQL Parquet Vectorized 122 125 3 128.4 7.8 169.6X -SQL Parquet MR 1993 1997 6 7.9 126.7 10.4X -SQL ORC Vectorized 234 238 4 67.1 14.9 88.6X -SQL ORC MR 1532 1542 15 10.3 97.4 13.6X +SQL CSV 27385 27423 54 0.6 1741.1 1.0X +SQL Json 10118 10133 20 1.6 643.3 2.7X +SQL Parquet Vectorized 180 189 10 87.4 11.4 152.1X +SQL Parquet MR 2548 2552 6 6.2 162.0 10.7X +SQL ORC Vectorized 306 312 8 51.4 19.4 89.5X +SQL ORC MR 1882 1927 64 8.4 119.6 14.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 209 216 9 75.4 13.3 1.0X -ParquetReader Vectorized -> Row 213 214 3 73.8 13.5 1.0X +ParquetReader Vectorized 255 260 7 61.7 16.2 1.0X +ParquetReader Vectorized -> Row 252 257 6 62.4 16.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 25388 25451 88 0.6 1614.1 1.0X -SQL Json 10515 10515 1 1.5 668.5 2.4X -SQL Parquet Vectorized 187 191 5 83.9 11.9 135.4X -SQL Parquet MR 2143 2152 13 7.3 136.2 11.8X -SQL ORC Vectorized 297 298 3 53.0 18.9 85.5X -SQL ORC MR 1620 1645 34 9.7 103.0 15.7X +SQL CSV 36971 37037 94 0.4 2350.5 1.0X +SQL Json 13285 13300 22 1.2 844.6 2.8X +SQL Parquet Vectorized 275 285 5 57.1 17.5 134.3X +SQL Parquet MR 2599 2603 6 6.1 165.3 14.2X +SQL ORC Vectorized 386 395 5 40.7 24.6 95.7X +SQL ORC MR 2059 2075 22 7.6 130.9 18.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 275 300 50 57.2 17.5 1.0X -ParquetReader Vectorized -> Row 274 278 6 57.4 17.4 1.0X +ParquetReader Vectorized 352 361 14 44.7 22.4 1.0X +ParquetReader Vectorized -> Row 386 392 8 40.7 24.6 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 20977 21047 98 0.7 1333.7 1.0X -SQL Json 10248 10280 45 1.5 651.6 2.0X -SQL Parquet Vectorized 127 130 4 123.5 8.1 164.7X -SQL Parquet MR 1956 1958 3 8.0 124.3 10.7X -SQL ORC Vectorized 319 320 2 49.4 20.3 65.8X -SQL ORC MR 1577 1648 101 10.0 100.2 13.3X +SQL CSV 29272 29322 71 0.5 1861.1 1.0X +SQL Json 15022 15099 108 1.0 955.1 1.9X +SQL Parquet Vectorized 172 178 6 91.5 10.9 170.2X +SQL Parquet MR 2184 2206 31 7.2 138.9 13.4X +SQL ORC Vectorized 477 485 6 32.9 30.4 61.3X +SQL ORC MR 2036 2054 26 7.7 129.4 14.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 209 211 5 75.4 13.3 1.0X -ParquetReader Vectorized -> Row 207 209 2 75.9 13.2 1.0X +ParquetReader Vectorized 251 255 5 62.6 16.0 1.0X +ParquetReader Vectorized -> Row 248 254 7 63.5 15.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 26434 26439 7 0.6 1680.6 1.0X -SQL Json 14231 14233 3 1.1 904.8 1.9X -SQL Parquet Vectorized 193 198 6 81.5 12.3 137.0X -SQL Parquet MR 2117 2123 8 7.4 134.6 12.5X -SQL ORC Vectorized 393 396 3 40.0 25.0 67.2X -SQL ORC MR 1680 1688 12 9.4 106.8 15.7X +SQL CSV 38020 38024 6 0.4 2417.2 1.0X +SQL Json 20449 20463 19 0.8 1300.1 1.9X +SQL Parquet Vectorized 268 274 8 58.7 17.0 141.8X +SQL Parquet MR 2484 2493 12 6.3 157.9 15.3X +SQL ORC Vectorized 580 582 2 27.1 36.9 65.6X +SQL ORC MR 2179 2199 29 7.2 138.5 17.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 271 279 7 58.0 17.2 1.0X -ParquetReader Vectorized -> Row 275 278 3 57.2 17.5 1.0X +ParquetReader Vectorized 344 350 7 45.7 21.9 1.0X +ParquetReader Vectorized -> Row 346 352 12 45.5 22.0 1.0X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 18302 18304 3 0.6 1745.4 1.0X -SQL Json 10005 10010 7 1.0 954.1 1.8X -SQL Parquet Vectorized 1912 1913 1 5.5 182.4 9.6X -SQL Parquet MR 3928 3928 0 2.7 374.6 4.7X -SQL ORC Vectorized 2070 2085 20 5.1 197.5 8.8X -SQL ORC MR 3555 3566 17 2.9 339.0 5.1X +SQL CSV 27652 28221 804 0.4 2637.1 1.0X +SQL Json 12827 12842 21 0.8 1223.3 2.2X +SQL Parquet Vectorized 2297 2311 19 4.6 219.1 12.0X +SQL Parquet MR 4207 4217 15 2.5 401.2 6.6X +SQL ORC Vectorized 2316 2342 36 4.5 220.9 11.9X +SQL ORC MR 4158 4236 110 2.5 396.5 6.7X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 11823 11851 39 0.9 1127.5 1.0X -SQL Json 5956 5960 6 1.8 568.0 2.0X -SQL Parquet Vectorized 656 666 9 16.0 62.6 18.0X -SQL Parquet MR 1627 1681 76 6.4 155.2 7.3X -SQL ORC Vectorized 456 461 6 23.0 43.5 25.9X -SQL ORC MR 1704 1743 54 6.2 162.5 6.9X +SQL CSV 19185 19343 224 0.5 1829.6 1.0X +SQL Json 7682 7692 14 1.4 732.6 2.5X +SQL Parquet Vectorized 796 805 9 13.2 75.9 24.1X +SQL Parquet MR 1880 1891 17 5.6 179.2 10.2X +SQL ORC Vectorized 553 558 5 19.0 52.7 34.7X +SQL ORC MR 2105 2128 32 5.0 200.8 9.1X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - CSV 26325 26392 94 0.6 1673.7 1.0X -Data column - Json 10918 10922 6 1.4 694.1 2.4X -Data column - Parquet Vectorized 207 211 3 75.8 13.2 126.9X -Data column - Parquet MR 2535 2539 6 6.2 161.1 10.4X -Data column - ORC Vectorized 313 315 3 50.2 19.9 84.1X -Data column - ORC MR 1859 1869 14 8.5 118.2 14.2X -Partition column - CSV 10229 10263 48 1.5 650.4 2.6X -Partition column - Json 9098 9107 13 1.7 578.4 2.9X -Partition column - Parquet Vectorized 59 61 5 265.3 3.8 444.1X -Partition column - Parquet MR 1089 1107 26 14.4 69.2 24.2X -Partition column - ORC Vectorized 59 62 6 265.1 3.8 443.7X -Partition column - ORC MR 1184 1196 18 13.3 75.3 22.2X -Both columns - CSV 26556 26557 1 0.6 1688.4 1.0X -Both columns - Json 11616 11617 3 1.4 738.5 2.3X -Both columns - Parquet Vectorized 246 249 3 63.9 15.7 106.9X -Both columns - Parquet MR 2567 2595 39 6.1 163.2 10.3X -Both columns - ORC Vectorized 435 438 3 36.2 27.6 60.5X -Both columns - ORC MR 2136 2159 32 7.4 135.8 12.3X +Data column - CSV 43759 43811 73 0.4 2782.1 1.0X +Data column - Json 13866 13874 11 1.1 881.6 3.2X +Data column - Parquet Vectorized 292 302 10 53.9 18.5 150.1X +Data column - Parquet MR 2681 2697 23 5.9 170.5 16.3X +Data column - ORC Vectorized 416 422 12 37.8 26.4 105.2X +Data column - ORC MR 2256 2275 27 7.0 143.4 19.4X +Partition column - CSV 13909 13949 56 1.1 884.3 3.1X +Partition column - Json 11248 11252 7 1.4 715.1 3.9X +Partition column - Parquet Vectorized 83 95 13 189.4 5.3 526.9X +Partition column - Parquet MR 1531 1532 2 10.3 97.3 28.6X +Partition column - ORC Vectorized 81 97 17 193.1 5.2 537.3X +Partition column - ORC MR 1557 1570 19 10.1 99.0 28.1X +Both columns - CSV 48341 48524 259 0.3 3073.4 0.9X +Both columns - Json 13636 13652 23 1.2 866.9 3.2X +Both columns - Parquet Vectorized 341 354 16 46.1 21.7 128.2X +Both columns - Parquet MR 2806 2825 26 5.6 178.4 15.6X +Both columns - ORC Vectorized 548 554 8 28.7 34.8 79.8X +Both columns - ORC MR 2602 2632 43 6.0 165.4 16.8X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 13138 13171 46 0.8 1253.0 1.0X -SQL Json 8932 8938 9 1.2 851.8 1.5X -SQL Parquet Vectorized 1211 1212 2 8.7 115.5 10.8X -SQL Parquet MR 3257 3282 36 3.2 310.6 4.0X -ParquetReader Vectorized 896 899 5 11.7 85.4 14.7X -SQL ORC Vectorized 1091 1091 1 9.6 104.0 12.0X -SQL ORC MR 3058 3078 28 3.4 291.6 4.3X +SQL CSV 22570 22687 166 0.5 2152.4 1.0X +SQL Json 11103 11129 38 0.9 1058.8 2.0X +SQL Parquet Vectorized 1508 1516 12 7.0 143.8 15.0X +SQL Parquet MR 3686 3692 9 2.8 351.5 6.1X +ParquetReader Vectorized 1117 1133 22 9.4 106.6 20.2X +SQL ORC Vectorized 1195 1212 24 8.8 114.0 18.9X +SQL ORC MR 3617 3618 3 2.9 344.9 6.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 12677 12696 26 0.8 1209.0 1.0X -SQL Json 6742 6743 2 1.6 643.0 1.9X -SQL Parquet Vectorized 939 942 4 11.2 89.6 13.5X -SQL Parquet MR 2388 2393 7 4.4 227.7 5.3X -ParquetReader Vectorized 867 869 3 12.1 82.7 14.6X -SQL ORC Vectorized 1179 1179 0 8.9 112.4 10.8X -SQL ORC MR 2841 2859 26 3.7 270.9 4.5X +SQL CSV 19569 19819 354 0.5 1866.2 1.0X +SQL Json 8292 8308 22 1.3 790.8 2.4X +SQL Parquet Vectorized 1107 1136 41 9.5 105.6 17.7X +SQL Parquet MR 2784 2812 39 3.8 265.5 7.0X +ParquetReader Vectorized 990 994 5 10.6 94.4 19.8X +SQL ORC Vectorized 1198 1199 2 8.8 114.2 16.3X +SQL ORC MR 3164 3195 44 3.3 301.7 6.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 10443 10484 58 1.0 995.9 1.0X -SQL Json 3812 3832 29 2.8 363.5 2.7X -SQL Parquet Vectorized 194 196 2 54.0 18.5 53.8X -SQL Parquet MR 1542 1543 2 6.8 147.0 6.8X -ParquetReader Vectorized 210 211 2 49.9 20.0 49.7X -SQL ORC Vectorized 374 375 2 28.0 35.7 27.9X -SQL ORC MR 1481 1483 3 7.1 141.2 7.1X +SQL CSV 15940 15969 41 0.7 1520.1 1.0X +SQL Json 4845 4845 0 2.2 462.0 3.3X +SQL Parquet Vectorized 243 249 6 43.1 23.2 65.5X +SQL Parquet MR 1732 1751 26 6.1 165.2 9.2X +ParquetReader Vectorized 241 243 3 43.4 23.0 66.0X +SQL ORC Vectorized 425 431 7 24.7 40.5 37.5X +SQL ORC MR 1713 1728 20 6.1 163.4 9.3X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 2592 2592 0 0.4 2471.8 1.0X -SQL Json 2966 2971 8 0.4 2828.2 0.9X -SQL Parquet Vectorized 44 46 4 24.0 41.6 59.4X -SQL Parquet MR 189 197 6 5.5 180.6 13.7X -SQL ORC Vectorized 49 52 5 21.3 47.0 52.6X -SQL ORC MR 151 156 5 6.9 143.9 17.2X +SQL CSV 3838 3885 66 0.3 3660.4 1.0X +SQL Json 3615 3615 0 0.3 3447.8 1.1X +SQL Parquet Vectorized 66 74 8 15.8 63.2 57.9X +SQL Parquet MR 230 237 6 4.6 219.3 16.7X +SQL ORC Vectorized 72 77 9 14.5 68.9 53.1X +SQL ORC MR 194 201 5 5.4 185.3 19.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 6214 6237 32 0.2 5926.5 1.0X -SQL Json 11936 12075 196 0.1 11383.3 0.5X -SQL Parquet Vectorized 78 80 3 13.5 74.1 80.0X -SQL Parquet MR 227 236 7 4.6 216.1 27.4X -SQL ORC Vectorized 81 84 5 13.0 76.9 77.0X -SQL ORC MR 184 187 3 5.7 175.7 33.7X +SQL CSV 8711 8754 60 0.1 8307.9 1.0X +SQL Json 14414 14423 12 0.1 13746.5 0.6X +SQL Parquet Vectorized 97 106 12 10.8 92.7 89.6X +SQL Parquet MR 267 274 7 3.9 254.2 32.7X +SQL ORC Vectorized 100 104 7 10.5 95.1 87.4X +SQL ORC MR 226 230 6 4.6 215.2 38.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 10648 10651 4 0.1 10155.0 1.0X -SQL Json 22835 22977 201 0.0 21777.3 0.5X -SQL Parquet Vectorized 118 119 2 8.9 112.3 90.4X -SQL Parquet MR 270 278 13 3.9 257.6 39.4X -SQL ORC Vectorized 104 107 5 10.1 99.4 102.1X -SQL ORC MR 209 214 5 5.0 199.6 50.9X +SQL CSV 14509 14596 123 0.1 13836.8 1.0X +SQL Json 27545 27909 515 0.0 26269.1 0.5X +SQL Parquet Vectorized 141 151 13 7.4 134.8 102.7X +SQL Parquet MR 313 341 23 3.4 298.4 46.4X +SQL ORC Vectorized 121 129 15 8.7 115.4 119.9X +SQL ORC MR 252 269 33 4.2 240.3 57.6X diff --git a/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt b/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt index bf84f4ffd663e..729b112de5e75 100644 --- a/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt @@ -2,428 +2,428 @@ Extract components ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp wholestage off 275 297 32 36.4 27.5 1.0X -cast to timestamp wholestage on 270 272 1 37.1 27.0 1.0X +cast to timestamp wholestage off 546 572 36 18.3 54.6 1.0X +cast to timestamp wholestage on 412 438 16 24.3 41.2 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -year of timestamp wholestage off 864 875 15 11.6 86.4 1.0X -year of timestamp wholestage on 866 881 13 11.5 86.6 1.0X +year of timestamp wholestage off 1240 1295 77 8.1 124.0 1.0X +year of timestamp wholestage on 1109 1130 24 9.0 110.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -quarter of timestamp wholestage off 1137 1138 2 8.8 113.7 1.0X -quarter of timestamp wholestage on 1112 1119 7 9.0 111.2 1.0X +quarter of timestamp wholestage off 1572 1574 3 6.4 157.2 1.0X +quarter of timestamp wholestage on 1386 1405 18 7.2 138.6 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -month of timestamp wholestage off 826 850 34 12.1 82.6 1.0X -month of timestamp wholestage on 816 821 3 12.3 81.6 1.0X +month of timestamp wholestage off 1194 1196 2 8.4 119.4 1.0X +month of timestamp wholestage on 1057 1069 12 9.5 105.7 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekofyear of timestamp wholestage off 1204 1209 6 8.3 120.4 1.0X -weekofyear of timestamp wholestage on 1217 1222 4 8.2 121.7 1.0X +weekofyear of timestamp wholestage off 2070 2071 2 4.8 207.0 1.0X +weekofyear of timestamp wholestage on 1549 1555 6 6.5 154.9 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -day of timestamp wholestage off 825 826 2 12.1 82.5 1.0X -day of timestamp wholestage on 810 819 12 12.3 81.0 1.0X +day of timestamp wholestage off 1173 1186 18 8.5 117.3 1.0X +day of timestamp wholestage on 1056 1076 26 9.5 105.6 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofyear of timestamp wholestage off 859 877 27 11.6 85.9 1.0X -dayofyear of timestamp wholestage on 847 857 9 11.8 84.7 1.0X +dayofyear of timestamp wholestage off 1207 1211 6 8.3 120.7 1.0X +dayofyear of timestamp wholestage on 1097 1108 9 9.1 109.7 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofmonth of timestamp wholestage off 850 852 3 11.8 85.0 1.0X -dayofmonth of timestamp wholestage on 813 820 8 12.3 81.3 1.0X +dayofmonth of timestamp wholestage off 1184 1190 8 8.4 118.4 1.0X +dayofmonth of timestamp wholestage on 1053 1060 9 9.5 105.3 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofweek of timestamp wholestage off 979 982 3 10.2 97.9 1.0X -dayofweek of timestamp wholestage on 969 981 12 10.3 96.9 1.0X +dayofweek of timestamp wholestage off 1343 1362 27 7.4 134.3 1.0X +dayofweek of timestamp wholestage on 1228 1239 7 8.1 122.8 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekday of timestamp wholestage off 930 931 2 10.8 93.0 1.0X -weekday of timestamp wholestage on 914 918 7 10.9 91.4 1.0X +weekday of timestamp wholestage off 1276 1278 3 7.8 127.6 1.0X +weekday of timestamp wholestage on 1160 1181 22 8.6 116.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hour of timestamp wholestage off 564 574 14 17.7 56.4 1.0X -hour of timestamp wholestage on 559 561 2 17.9 55.9 1.0X +hour of timestamp wholestage off 854 862 12 11.7 85.4 1.0X +hour of timestamp wholestage on 741 748 6 13.5 74.1 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -minute of timestamp wholestage off 576 577 1 17.4 57.6 1.0X -minute of timestamp wholestage on 568 570 2 17.6 56.8 1.0X +minute of timestamp wholestage off 853 854 1 11.7 85.3 1.0X +minute of timestamp wholestage on 730 737 11 13.7 73.0 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -second of timestamp wholestage off 457 459 3 21.9 45.7 1.0X -second of timestamp wholestage on 436 440 4 22.9 43.6 1.0X +second of timestamp wholestage off 726 728 2 13.8 72.6 1.0X +second of timestamp wholestage on 614 623 9 16.3 61.4 1.2X ================================================================================================ Current date and time ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_date wholestage off 211 216 8 47.5 21.1 1.0X -current_date wholestage on 227 229 2 44.1 22.7 0.9X +current_date wholestage off 369 370 2 27.1 36.9 1.0X +current_date wholestage on 277 284 8 36.2 27.7 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_timestamp wholestage off 230 287 80 43.4 23.0 1.0X -current_timestamp wholestage on 219 235 21 45.7 21.9 1.1X +current_timestamp wholestage off 410 411 1 24.4 41.0 1.0X +current_timestamp wholestage on 283 418 259 35.4 28.3 1.5X ================================================================================================ Date arithmetic ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date wholestage off 691 696 7 14.5 69.1 1.0X -cast to date wholestage on 674 680 4 14.8 67.4 1.0X +cast to date wholestage off 987 992 7 10.1 98.7 1.0X +cast to date wholestage on 891 896 4 11.2 89.1 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -last_day wholestage off 849 854 7 11.8 84.9 1.0X -last_day wholestage on 820 826 5 12.2 82.0 1.0X +last_day wholestage off 1179 1179 1 8.5 117.9 1.0X +last_day wholestage on 1052 1080 44 9.5 105.2 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -next_day wholestage off 728 730 3 13.7 72.8 1.0X -next_day wholestage on 734 739 5 13.6 73.4 1.0X +next_day wholestage off 1073 1081 11 9.3 107.3 1.0X +next_day wholestage on 948 955 10 10.5 94.8 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_add wholestage off 690 690 1 14.5 69.0 1.0X -date_add wholestage on 663 667 4 15.1 66.3 1.0X +date_add wholestage off 1006 1009 5 9.9 100.6 1.0X +date_add wholestage on 867 870 4 11.5 86.7 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_sub wholestage off 680 706 37 14.7 68.0 1.0X -date_sub wholestage on 663 670 10 15.1 66.3 1.0X +date_sub wholestage off 980 988 11 10.2 98.0 1.0X +date_sub wholestage on 866 873 9 11.6 86.6 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -add_months wholestage off 954 961 9 10.5 95.4 1.0X -add_months wholestage on 936 943 5 10.7 93.6 1.0X +add_months wholestage off 1329 1332 4 7.5 132.9 1.0X +add_months wholestage on 1199 1206 8 8.3 119.9 1.1X ================================================================================================ Formatting dates ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -format date wholestage off 4401 4432 45 2.3 440.1 1.0X -format date wholestage on 4318 4335 17 2.3 431.8 1.0X +format date wholestage off 4724 4736 18 2.1 472.4 1.0X +format date wholestage on 4550 4574 26 2.2 455.0 1.0X ================================================================================================ Formatting timestamps ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_unixtime wholestage off 6550 6561 16 1.5 655.0 1.0X -from_unixtime wholestage on 6554 6567 12 1.5 655.4 1.0X +from_unixtime wholestage off 7171 7183 17 1.4 717.1 1.0X +from_unixtime wholestage on 7114 7141 20 1.4 711.4 1.0X ================================================================================================ Convert timestamps ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_utc_timestamp wholestage off 1036 1038 2 9.6 103.6 1.0X -from_utc_timestamp wholestage on 1145 1148 2 8.7 114.5 0.9X +from_utc_timestamp wholestage off 1498 1504 8 6.7 149.8 1.0X +from_utc_timestamp wholestage on 1399 1405 5 7.1 139.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_utc_timestamp wholestage off 1191 1194 4 8.4 119.1 1.0X -to_utc_timestamp wholestage on 1160 1162 3 8.6 116.0 1.0X +to_utc_timestamp wholestage off 1505 1507 2 6.6 150.5 1.0X +to_utc_timestamp wholestage on 1396 1401 5 7.2 139.6 1.1X ================================================================================================ Intervals ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast interval wholestage off 260 260 1 38.5 26.0 1.0X -cast interval wholestage on 234 235 1 42.7 23.4 1.1X +cast interval wholestage off 423 428 7 23.6 42.3 1.0X +cast interval wholestage on 300 302 2 33.3 30.0 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -datediff wholestage off 1359 1361 3 7.4 135.9 1.0X -datediff wholestage on 1154 1156 3 8.7 115.4 1.2X +datediff wholestage off 1626 1630 6 6.1 162.6 1.0X +datediff wholestage on 1467 1471 3 6.8 146.7 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -months_between wholestage off 1454 1455 1 6.9 145.4 1.0X -months_between wholestage on 1405 1410 6 7.1 140.5 1.0X +months_between wholestage off 1988 1992 5 5.0 198.8 1.0X +months_between wholestage on 1812 1834 24 5.5 181.2 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -window wholestage off 1577 1603 36 0.6 1576.9 1.0X -window wholestage on 17162 17200 55 0.1 17162.2 0.1X +window wholestage off 2277 2334 80 0.4 2277.1 1.0X +window wholestage on 48996 49048 67 0.0 48996.0 0.0X ================================================================================================ Truncation ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YEAR wholestage off 597 604 10 16.8 59.7 1.0X -date_trunc YEAR wholestage on 577 578 1 17.3 57.7 1.0X +date_trunc YEAR wholestage off 867 870 6 11.5 86.7 1.0X +date_trunc YEAR wholestage on 815 819 6 12.3 81.5 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YYYY wholestage off 597 597 0 16.8 59.7 1.0X -date_trunc YYYY wholestage on 577 580 3 17.3 57.7 1.0X +date_trunc YYYY wholestage off 866 875 13 11.5 86.6 1.0X +date_trunc YYYY wholestage on 811 813 2 12.3 81.1 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YY wholestage off 597 598 1 16.7 59.7 1.0X -date_trunc YY wholestage on 577 579 2 17.3 57.7 1.0X +date_trunc YY wholestage off 864 867 4 11.6 86.4 1.0X +date_trunc YY wholestage on 812 824 10 12.3 81.2 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MON wholestage off 609 609 0 16.4 60.9 1.0X -date_trunc MON wholestage on 566 567 1 17.7 56.6 1.1X +date_trunc MON wholestage off 881 884 4 11.3 88.1 1.0X +date_trunc MON wholestage on 820 826 7 12.2 82.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MONTH wholestage off 609 610 1 16.4 60.9 1.0X -date_trunc MONTH wholestage on 566 567 1 17.7 56.6 1.1X +date_trunc MONTH wholestage off 880 881 2 11.4 88.0 1.0X +date_trunc MONTH wholestage on 819 822 4 12.2 81.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MM wholestage off 616 632 23 16.2 61.6 1.0X -date_trunc MM wholestage on 566 567 1 17.7 56.6 1.1X +date_trunc MM wholestage off 889 904 21 11.2 88.9 1.0X +date_trunc MM wholestage on 818 828 8 12.2 81.8 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DAY wholestage off 401 401 0 25.0 40.1 1.0X -date_trunc DAY wholestage on 390 391 1 25.6 39.0 1.0X +date_trunc DAY wholestage off 590 593 4 16.9 59.0 1.0X +date_trunc DAY wholestage on 510 514 4 19.6 51.0 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DD wholestage off 403 405 4 24.8 40.3 1.0X -date_trunc DD wholestage on 390 396 8 25.6 39.0 1.0X +date_trunc DD wholestage off 596 604 11 16.8 59.6 1.0X +date_trunc DD wholestage on 511 519 9 19.6 51.1 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc HOUR wholestage off 424 425 2 23.6 42.4 1.0X -date_trunc HOUR wholestage on 412 413 2 24.3 41.2 1.0X +date_trunc HOUR wholestage off 586 592 9 17.1 58.6 1.0X +date_trunc HOUR wholestage on 507 513 5 19.7 50.7 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MINUTE wholestage off 386 388 2 25.9 38.6 1.0X -date_trunc MINUTE wholestage on 372 373 1 26.9 37.2 1.0X +date_trunc MINUTE wholestage off 561 562 1 17.8 56.1 1.0X +date_trunc MINUTE wholestage on 480 485 4 20.8 48.0 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc SECOND wholestage off 409 410 1 24.5 40.9 1.0X -date_trunc SECOND wholestage on 376 379 2 26.6 37.6 1.1X +date_trunc SECOND wholestage off 561 561 1 17.8 56.1 1.0X +date_trunc SECOND wholestage on 479 480 2 20.9 47.9 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc WEEK wholestage off 491 492 2 20.4 49.1 1.0X -date_trunc WEEK wholestage on 458 459 1 21.8 45.8 1.1X +date_trunc WEEK wholestage off 725 727 2 13.8 72.5 1.0X +date_trunc WEEK wholestage on 674 684 11 14.8 67.4 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc QUARTER wholestage off 1202 1204 3 8.3 120.2 1.0X -date_trunc QUARTER wholestage on 1164 1165 1 8.6 116.4 1.0X +date_trunc QUARTER wholestage off 1653 1659 10 6.1 165.3 1.0X +date_trunc QUARTER wholestage on 1588 1601 12 6.3 158.8 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc year wholestage off 237 237 0 42.2 23.7 1.0X -trunc year wholestage on 242 244 2 41.4 24.2 1.0X +trunc year wholestage off 391 393 2 25.6 39.1 1.0X +trunc year wholestage on 312 316 4 32.1 31.2 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yyyy wholestage off 237 238 1 42.1 23.7 1.0X -trunc yyyy wholestage on 241 243 1 41.4 24.1 1.0X +trunc yyyy wholestage off 390 394 5 25.6 39.0 1.0X +trunc yyyy wholestage on 316 319 4 31.6 31.6 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yy wholestage off 237 237 1 42.3 23.7 1.0X -trunc yy wholestage on 242 247 5 41.3 24.2 1.0X +trunc yy wholestage off 387 390 5 25.8 38.7 1.0X +trunc yy wholestage on 313 316 3 31.9 31.3 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mon wholestage off 236 236 0 42.4 23.6 1.0X -trunc mon wholestage on 242 243 1 41.3 24.2 1.0X +trunc mon wholestage off 388 395 11 25.8 38.8 1.0X +trunc mon wholestage on 314 316 2 31.8 31.4 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc month wholestage off 236 236 0 42.4 23.6 1.0X -trunc month wholestage on 242 243 0 41.2 24.2 1.0X +trunc month wholestage off 388 390 4 25.8 38.8 1.0X +trunc month wholestage on 315 318 2 31.7 31.5 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mm wholestage off 236 237 2 42.4 23.6 1.0X -trunc mm wholestage on 241 242 1 41.4 24.1 1.0X +trunc mm wholestage off 384 388 4 26.0 38.4 1.0X +trunc mm wholestage on 314 321 9 31.9 31.4 1.2X ================================================================================================ Parsing ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to timestamp str wholestage off 146 147 1 6.8 146.4 1.0X -to timestamp str wholestage on 142 142 0 7.0 141.9 1.0X +to timestamp str wholestage off 178 191 18 5.6 178.5 1.0X +to timestamp str wholestage on 157 160 2 6.4 156.6 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_timestamp wholestage off 1378 1380 3 0.7 1378.5 1.0X -to_timestamp wholestage on 1357 1358 1 0.7 1357.1 1.0X +to_timestamp wholestage off 1790 1795 7 0.6 1790.0 1.0X +to_timestamp wholestage on 1813 1820 10 0.6 1813.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_unix_timestamp wholestage off 1354 1354 0 0.7 1354.1 1.0X -to_unix_timestamp wholestage on 1347 1349 1 0.7 1347.4 1.0X +to_unix_timestamp wholestage off 1836 1837 1 0.5 1835.8 1.0X +to_unix_timestamp wholestage on 1786 1791 3 0.6 1785.8 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to date str wholestage off 142 143 0 7.0 142.4 1.0X -to date str wholestage on 138 138 0 7.2 138.3 1.0X +to date str wholestage off 169 169 1 5.9 168.8 1.0X +to date str wholestage on 151 153 2 6.6 151.2 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_date wholestage off 1700 1703 4 0.6 1699.9 1.0X -to_date wholestage on 1697 1702 3 0.6 1697.5 1.0X +to_date wholestage off 2504 2512 10 0.4 2504.4 1.0X +to_date wholestage on 2522 2536 19 0.4 2522.3 1.0X ================================================================================================ Conversion from/to external types ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -From java.sql.Timestamp 267 267 0 18.7 53.4 1.0X -Collect longs 1266 1948 592 3.9 253.3 0.2X -Collect timestamps 1752 2097 534 2.9 350.5 0.2X +From java.sql.Timestamp 346 367 35 14.5 69.2 1.0X +Collect longs 2139 2329 289 2.3 427.7 0.2X +Collect timestamps 1883 2086 303 2.7 376.5 0.2X diff --git a/sql/core/benchmarks/DateTimeBenchmark-results.txt b/sql/core/benchmarks/DateTimeBenchmark-results.txt index 415bf0b628672..0c30534dd71ca 100644 --- a/sql/core/benchmarks/DateTimeBenchmark-results.txt +++ b/sql/core/benchmarks/DateTimeBenchmark-results.txt @@ -2,428 +2,428 @@ Extract components ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp wholestage off 276 286 14 36.2 27.6 1.0X -cast to timestamp wholestage on 244 259 15 40.9 24.4 1.1X +cast to timestamp wholestage off 425 447 30 23.5 42.5 1.0X +cast to timestamp wholestage on 368 401 29 27.2 36.8 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -year of timestamp wholestage off 962 967 7 10.4 96.2 1.0X -year of timestamp wholestage on 875 891 15 11.4 87.5 1.1X +year of timestamp wholestage off 1158 1215 80 8.6 115.8 1.0X +year of timestamp wholestage on 1158 1179 31 8.6 115.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -quarter of timestamp wholestage off 952 963 15 10.5 95.2 1.0X -quarter of timestamp wholestage on 932 943 10 10.7 93.2 1.0X +quarter of timestamp wholestage off 1285 1295 15 7.8 128.5 1.0X +quarter of timestamp wholestage on 1243 1257 11 8.0 124.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -month of timestamp wholestage off 819 824 8 12.2 81.9 1.0X -month of timestamp wholestage on 809 815 6 12.4 80.9 1.0X +month of timestamp wholestage off 1076 1082 8 9.3 107.6 1.0X +month of timestamp wholestage on 1088 1098 9 9.2 108.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekofyear of timestamp wholestage off 1478 1478 0 6.8 147.8 1.0X -weekofyear of timestamp wholestage on 1236 1245 6 8.1 123.6 1.2X +weekofyear of timestamp wholestage off 1649 1659 14 6.1 164.9 1.0X +weekofyear of timestamp wholestage on 1648 1656 8 6.1 164.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -day of timestamp wholestage off 830 830 0 12.0 83.0 1.0X -day of timestamp wholestage on 804 808 5 12.4 80.4 1.0X +day of timestamp wholestage off 1083 1084 3 9.2 108.3 1.0X +day of timestamp wholestage on 1082 1089 13 9.2 108.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofyear of timestamp wholestage off 859 861 2 11.6 85.9 1.0X -dayofyear of timestamp wholestage on 841 854 11 11.9 84.1 1.0X +dayofyear of timestamp wholestage off 1102 1103 1 9.1 110.2 1.0X +dayofyear of timestamp wholestage on 1123 1138 14 8.9 112.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofmonth of timestamp wholestage off 844 845 1 11.8 84.4 1.0X -dayofmonth of timestamp wholestage on 827 835 9 12.1 82.7 1.0X +dayofmonth of timestamp wholestage off 1068 1073 7 9.4 106.8 1.0X +dayofmonth of timestamp wholestage on 1082 1095 13 9.2 108.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofweek of timestamp wholestage off 993 994 2 10.1 99.3 1.0X -dayofweek of timestamp wholestage on 955 955 1 10.5 95.5 1.0X +dayofweek of timestamp wholestage off 1265 1294 41 7.9 126.5 1.0X +dayofweek of timestamp wholestage on 1253 1262 11 8.0 125.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekday of timestamp wholestage off 931 936 8 10.7 93.1 1.0X -weekday of timestamp wholestage on 907 915 10 11.0 90.7 1.0X +weekday of timestamp wholestage off 1189 1191 3 8.4 118.9 1.0X +weekday of timestamp wholestage on 1193 1199 6 8.4 119.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hour of timestamp wholestage off 277 277 1 36.1 27.7 1.0X -hour of timestamp wholestage on 247 251 5 40.4 24.7 1.1X +hour of timestamp wholestage off 366 368 3 27.3 36.6 1.0X +hour of timestamp wholestage on 360 364 6 27.8 36.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -minute of timestamp wholestage off 264 265 1 37.8 26.4 1.0X -minute of timestamp wholestage on 249 252 3 40.2 24.9 1.1X +minute of timestamp wholestage off 348 350 2 28.7 34.8 1.0X +minute of timestamp wholestage on 355 361 9 28.1 35.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -second of timestamp wholestage off 257 257 0 39.0 25.7 1.0X -second of timestamp wholestage on 246 254 14 40.6 24.6 1.0X +second of timestamp wholestage off 347 352 7 28.8 34.7 1.0X +second of timestamp wholestage on 351 359 10 28.5 35.1 1.0X ================================================================================================ Current date and time ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_date wholestage off 210 210 0 47.6 21.0 1.0X -current_date wholestage on 223 236 16 44.8 22.3 0.9X +current_date wholestage off 284 287 4 35.2 28.4 1.0X +current_date wholestage on 312 318 6 32.1 31.2 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_timestamp wholestage off 212 214 3 47.1 21.2 1.0X -current_timestamp wholestage on 206 208 2 48.5 20.6 1.0X +current_timestamp wholestage off 291 292 2 34.4 29.1 1.0X +current_timestamp wholestage on 297 333 40 33.6 29.7 1.0X ================================================================================================ Date arithmetic ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date wholestage off 687 693 9 14.6 68.7 1.0X -cast to date wholestage on 653 654 2 15.3 65.3 1.1X +cast to date wholestage off 903 903 1 11.1 90.3 1.0X +cast to date wholestage on 897 900 7 11.2 89.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -last_day wholestage off 837 845 11 11.9 83.7 1.0X -last_day wholestage on 834 838 3 12.0 83.4 1.0X +last_day wholestage off 1082 1082 1 9.2 108.2 1.0X +last_day wholestage on 1107 1118 16 9.0 110.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -next_day wholestage off 725 726 2 13.8 72.5 1.0X -next_day wholestage on 706 713 13 14.2 70.6 1.0X +next_day wholestage off 968 974 8 10.3 96.8 1.0X +next_day wholestage on 958 959 1 10.4 95.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_add wholestage off 665 670 7 15.0 66.5 1.0X -date_add wholestage on 650 662 23 15.4 65.0 1.0X +date_add wholestage off 894 895 1 11.2 89.4 1.0X +date_add wholestage on 882 890 9 11.3 88.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_sub wholestage off 661 663 4 15.1 66.1 1.0X -date_sub wholestage on 651 658 12 15.4 65.1 1.0X +date_sub wholestage off 892 896 6 11.2 89.2 1.0X +date_sub wholestage on 881 888 7 11.3 88.1 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -add_months wholestage off 951 952 1 10.5 95.1 1.0X -add_months wholestage on 932 943 9 10.7 93.2 1.0X +add_months wholestage off 1221 1223 3 8.2 122.1 1.0X +add_months wholestage on 1212 1217 5 8.2 121.2 1.0X ================================================================================================ Formatting dates ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -format date wholestage off 3997 4052 78 2.5 399.7 1.0X -format date wholestage on 3984 3998 15 2.5 398.4 1.0X +format date wholestage off 4989 5009 29 2.0 498.9 1.0X +format date wholestage on 5037 5055 26 2.0 503.7 1.0X ================================================================================================ Formatting timestamps ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_unixtime wholestage off 6297 6301 6 1.6 629.7 1.0X -from_unixtime wholestage on 6219 6223 5 1.6 621.9 1.0X +from_unixtime wholestage off 9157 9164 10 1.1 915.7 1.0X +from_unixtime wholestage on 9101 9120 16 1.1 910.1 1.0X ================================================================================================ Convert timestamps ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_utc_timestamp wholestage off 596 596 0 16.8 59.6 1.0X -from_utc_timestamp wholestage on 610 612 1 16.4 61.0 1.0X +from_utc_timestamp wholestage off 732 739 10 13.7 73.2 1.0X +from_utc_timestamp wholestage on 767 776 8 13.0 76.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_utc_timestamp wholestage off 654 654 0 15.3 65.4 1.0X -to_utc_timestamp wholestage on 614 620 7 16.3 61.4 1.1X +to_utc_timestamp wholestage off 802 805 3 12.5 80.2 1.0X +to_utc_timestamp wholestage on 776 781 5 12.9 77.6 1.0X ================================================================================================ Intervals ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast interval wholestage off 254 254 0 39.3 25.4 1.0X -cast interval wholestage on 233 236 3 43.0 23.3 1.1X +cast interval wholestage off 328 330 3 30.5 32.8 1.0X +cast interval wholestage on 319 326 7 31.3 31.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -datediff wholestage off 1339 1341 1 7.5 133.9 1.0X -datediff wholestage on 1140 1146 6 8.8 114.0 1.2X +datediff wholestage off 1762 1764 3 5.7 176.2 1.0X +datediff wholestage on 1495 1502 7 6.7 149.5 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -months_between wholestage off 1010 1011 1 9.9 101.0 1.0X -months_between wholestage on 967 972 5 10.3 96.7 1.0X +months_between wholestage off 1338 1339 1 7.5 133.8 1.0X +months_between wholestage on 1334 1339 5 7.5 133.4 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -window wholestage off 1417 1419 3 0.7 1417.2 1.0X -window wholestage on 16215 16246 19 0.1 16215.4 0.1X +window wholestage off 2023 2094 100 0.5 2023.2 1.0X +window wholestage on 43505 43551 33 0.0 43504.8 0.0X ================================================================================================ Truncation ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YEAR wholestage off 511 517 8 19.6 51.1 1.0X -date_trunc YEAR wholestage on 446 448 2 22.4 44.6 1.1X +date_trunc YEAR wholestage off 660 661 1 15.1 66.0 1.0X +date_trunc YEAR wholestage on 589 599 7 17.0 58.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YYYY wholestage off 508 508 0 19.7 50.8 1.0X -date_trunc YYYY wholestage on 446 452 9 22.4 44.6 1.1X +date_trunc YYYY wholestage off 656 657 1 15.2 65.6 1.0X +date_trunc YYYY wholestage on 593 604 16 16.9 59.3 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YY wholestage off 508 508 0 19.7 50.8 1.0X -date_trunc YY wholestage on 445 448 4 22.5 44.5 1.1X +date_trunc YY wholestage off 666 669 4 15.0 66.6 1.0X +date_trunc YY wholestage on 591 603 19 16.9 59.1 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MON wholestage off 516 528 18 19.4 51.6 1.0X -date_trunc MON wholestage on 422 425 4 23.7 42.2 1.2X +date_trunc MON wholestage off 592 592 1 16.9 59.2 1.0X +date_trunc MON wholestage on 569 580 8 17.6 56.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MONTH wholestage off 523 525 2 19.1 52.3 1.0X -date_trunc MONTH wholestage on 423 425 2 23.6 42.3 1.2X +date_trunc MONTH wholestage off 593 594 2 16.9 59.3 1.0X +date_trunc MONTH wholestage on 575 579 4 17.4 57.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MM wholestage off 515 515 0 19.4 51.5 1.0X -date_trunc MM wholestage on 422 424 2 23.7 42.2 1.2X +date_trunc MM wholestage off 589 590 2 17.0 58.9 1.0X +date_trunc MM wholestage on 569 575 4 17.6 56.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DAY wholestage off 271 271 0 37.0 27.1 1.0X -date_trunc DAY wholestage on 257 258 2 38.9 25.7 1.1X +date_trunc DAY wholestage off 438 442 5 22.8 43.8 1.0X +date_trunc DAY wholestage on 346 350 4 28.9 34.6 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DD wholestage off 271 278 10 36.9 27.1 1.0X -date_trunc DD wholestage on 259 265 10 38.6 25.9 1.0X +date_trunc DD wholestage off 438 439 2 22.8 43.8 1.0X +date_trunc DD wholestage on 347 354 7 28.8 34.7 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc HOUR wholestage off 281 282 1 35.6 28.1 1.0X -date_trunc HOUR wholestage on 254 258 4 39.3 25.4 1.1X +date_trunc HOUR wholestage off 384 386 2 26.0 38.4 1.0X +date_trunc HOUR wholestage on 357 365 6 28.0 35.7 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MINUTE wholestage off 262 262 0 38.2 26.2 1.0X -date_trunc MINUTE wholestage on 245 248 3 40.9 24.5 1.1X +date_trunc MINUTE wholestage off 373 375 3 26.8 37.3 1.0X +date_trunc MINUTE wholestage on 327 331 5 30.6 32.7 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc SECOND wholestage off 253 273 29 39.5 25.3 1.0X -date_trunc SECOND wholestage on 245 246 1 40.9 24.5 1.0X +date_trunc SECOND wholestage off 361 363 3 27.7 36.1 1.0X +date_trunc SECOND wholestage on 335 341 8 29.9 33.5 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc WEEK wholestage off 355 356 1 28.2 35.5 1.0X -date_trunc WEEK wholestage on 322 327 10 31.0 32.2 1.1X +date_trunc WEEK wholestage off 515 516 2 19.4 51.5 1.0X +date_trunc WEEK wholestage on 455 459 4 22.0 45.5 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc QUARTER wholestage off 1032 1052 29 9.7 103.2 1.0X -date_trunc QUARTER wholestage on 992 996 4 10.1 99.2 1.0X +date_trunc QUARTER wholestage off 1337 1341 6 7.5 133.7 1.0X +date_trunc QUARTER wholestage on 1328 1334 10 7.5 132.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc year wholestage off 227 227 0 44.1 22.7 1.0X -trunc year wholestage on 212 216 7 47.2 21.2 1.1X +trunc year wholestage off 318 328 14 31.4 31.8 1.0X +trunc year wholestage on 297 308 17 33.6 29.7 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yyyy wholestage off 223 225 2 44.8 22.3 1.0X -trunc yyyy wholestage on 212 216 7 47.3 21.2 1.1X +trunc yyyy wholestage off 318 319 2 31.5 31.8 1.0X +trunc yyyy wholestage on 296 302 10 33.8 29.6 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yy wholestage off 226 226 0 44.3 22.6 1.0X -trunc yy wholestage on 211 212 1 47.3 21.1 1.1X +trunc yy wholestage off 321 345 35 31.2 32.1 1.0X +trunc yy wholestage on 297 319 45 33.6 29.7 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mon wholestage off 227 227 0 44.1 22.7 1.0X -trunc mon wholestage on 211 213 2 47.4 21.1 1.1X +trunc mon wholestage off 318 318 0 31.5 31.8 1.0X +trunc mon wholestage on 299 306 6 33.4 29.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc month wholestage off 226 226 0 44.2 22.6 1.0X -trunc month wholestage on 212 217 9 47.2 21.2 1.1X +trunc month wholestage off 316 318 3 31.6 31.6 1.0X +trunc month wholestage on 296 301 7 33.8 29.6 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mm wholestage off 226 226 0 44.3 22.6 1.0X -trunc mm wholestage on 211 217 11 47.3 21.1 1.1X +trunc mm wholestage off 316 321 8 31.7 31.6 1.0X +trunc mm wholestage on 295 302 8 33.9 29.5 1.1X ================================================================================================ Parsing ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to timestamp str wholestage off 162 164 3 6.2 162.1 1.0X -to timestamp str wholestage on 164 166 2 6.1 163.7 1.0X +to timestamp str wholestage off 219 220 1 4.6 219.3 1.0X +to timestamp str wholestage on 212 214 2 4.7 212.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_timestamp wholestage off 1269 1270 1 0.8 1269.3 1.0X -to_timestamp wholestage on 1219 1222 4 0.8 1219.1 1.0X +to_timestamp wholestage off 1852 1852 1 0.5 1851.9 1.0X +to_timestamp wholestage on 1862 1869 9 0.5 1861.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_unix_timestamp wholestage off 1230 1232 2 0.8 1230.3 1.0X -to_unix_timestamp wholestage on 1224 1225 2 0.8 1223.7 1.0X +to_unix_timestamp wholestage off 1839 1842 4 0.5 1839.1 1.0X +to_unix_timestamp wholestage on 1861 1866 4 0.5 1861.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to date str wholestage off 161 163 2 6.2 161.2 1.0X -to date str wholestage on 156 158 2 6.4 156.3 1.0X +to date str wholestage off 222 228 9 4.5 221.6 1.0X +to date str wholestage on 210 211 2 4.8 209.5 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_date wholestage off 1425 1429 5 0.7 1425.4 1.0X -to_date wholestage on 1399 1400 1 0.7 1398.6 1.0X +to_date wholestage off 2386 2392 8 0.4 2386.3 1.0X +to_date wholestage on 2438 2457 18 0.4 2437.7 1.0X ================================================================================================ Conversion from/to external types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -From java.sql.Timestamp 206 207 1 24.3 41.2 1.0X -Collect longs 1055 2097 1686 4.7 211.1 0.2X -Collect timestamps 1253 1288 50 4.0 250.5 0.2X +From java.sql.Timestamp 287 291 7 17.4 57.3 1.0X +Collect longs 1903 2672 694 2.6 380.6 0.2X +Collect timestamps 1544 1644 89 3.2 308.8 0.2X diff --git a/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt b/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt index fed40da52e0ad..0572cc25bf6c2 100644 --- a/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt @@ -1,119 +1,119 @@ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 246 273 39 40.7 24.6 1.0X -MILLENNIUM of timestamp 897 900 2 11.1 89.7 0.3X -CENTURY of timestamp 897 901 5 11.1 89.7 0.3X -DECADE of timestamp 887 897 13 11.3 88.7 0.3X -YEAR of timestamp 863 866 3 11.6 86.3 0.3X -ISOYEAR of timestamp 953 956 3 10.5 95.3 0.3X -QUARTER of timestamp 1016 1027 9 9.8 101.6 0.2X -MONTH of timestamp 857 859 2 11.7 85.7 0.3X -WEEK of timestamp 1241 1247 6 8.1 124.1 0.2X -DAY of timestamp 880 883 3 11.4 88.0 0.3X -DAYOFWEEK of timestamp 1015 1018 3 9.9 101.5 0.2X -DOW of timestamp 1009 1019 16 9.9 100.9 0.2X -ISODOW of timestamp 964 967 3 10.4 96.4 0.3X -DOY of timestamp 889 893 6 11.3 88.9 0.3X -HOUR of timestamp 536 538 2 18.7 53.6 0.5X -MINUTE of timestamp 539 541 3 18.6 53.9 0.5X -SECOND of timestamp 420 422 2 23.8 42.0 0.6X -MILLISECONDS of timestamp 440 443 3 22.7 44.0 0.6X -MICROSECONDS of timestamp 340 341 2 29.4 34.0 0.7X -EPOCH of timestamp 755 755 1 13.2 75.5 0.3X +cast to timestamp 380 456 67 26.3 38.0 1.0X +MILLENNIUM of timestamp 1274 1361 138 7.9 127.4 0.3X +CENTURY of timestamp 1119 1132 19 8.9 111.9 0.3X +DECADE of timestamp 1076 1083 6 9.3 107.6 0.4X +YEAR of timestamp 1066 1098 43 9.4 106.6 0.4X +ISOYEAR of timestamp 1190 1194 4 8.4 119.0 0.3X +QUARTER of timestamp 1269 1273 4 7.9 126.9 0.3X +MONTH of timestamp 1060 1075 22 9.4 106.0 0.4X +WEEK of timestamp 1560 1565 8 6.4 156.0 0.2X +DAY of timestamp 1039 1046 8 9.6 103.9 0.4X +DAYOFWEEK of timestamp 1248 1274 24 8.0 124.8 0.3X +DOW of timestamp 1252 1273 25 8.0 125.2 0.3X +ISODOW of timestamp 1195 1204 9 8.4 119.5 0.3X +DOY of timestamp 1081 1086 6 9.3 108.1 0.4X +HOUR of timestamp 778 781 5 12.9 77.8 0.5X +MINUTE of timestamp 779 780 1 12.8 77.9 0.5X +SECOND of timestamp 597 611 20 16.7 59.7 0.6X +MILLISECONDS of timestamp 636 642 6 15.7 63.6 0.6X +MICROSECONDS of timestamp 498 504 5 20.1 49.8 0.8X +EPOCH of timestamp 946 956 9 10.6 94.6 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 215 216 2 46.5 21.5 1.0X -MILLENNIUM of timestamp 880 888 11 11.4 88.0 0.2X -CENTURY of timestamp 880 894 14 11.4 88.0 0.2X -DECADE of timestamp 874 875 2 11.4 87.4 0.2X -YEAR of timestamp 849 850 1 11.8 84.9 0.3X -ISOYEAR of timestamp 1051 1054 2 9.5 105.1 0.2X -QUARTER of timestamp 994 1001 9 10.1 99.4 0.2X -MONTH of timestamp 870 876 7 11.5 87.0 0.2X -WEEK of timestamp 1230 1231 2 8.1 123.0 0.2X -DAY of timestamp 848 851 2 11.8 84.8 0.3X -DAYOFWEEK of timestamp 1009 1011 1 9.9 100.9 0.2X -DOW of timestamp 1005 1007 3 10.0 100.5 0.2X -ISODOW of timestamp 958 965 10 10.4 95.8 0.2X -DOY of timestamp 886 892 10 11.3 88.6 0.2X -HOUR of timestamp 530 533 3 18.9 53.0 0.4X -MINUTE of timestamp 533 535 2 18.8 53.3 0.4X -SECOND of timestamp 414 414 1 24.2 41.4 0.5X -MILLISECONDS of timestamp 438 438 2 22.9 43.8 0.5X -MICROSECONDS of timestamp 328 332 4 30.5 32.8 0.7X -EPOCH of timestamp 749 751 2 13.3 74.9 0.3X +cast to timestamp 356 362 9 28.1 35.6 1.0X +MILLENNIUM of timestamp 1260 1297 41 7.9 126.0 0.3X +CENTURY of timestamp 1082 1085 3 9.2 108.2 0.3X +DECADE of timestamp 1056 1068 19 9.5 105.6 0.3X +YEAR of timestamp 1045 1053 13 9.6 104.5 0.3X +ISOYEAR of timestamp 1300 1316 25 7.7 130.0 0.3X +QUARTER of timestamp 1279 1280 2 7.8 127.9 0.3X +MONTH of timestamp 1037 1046 11 9.6 103.7 0.3X +WEEK of timestamp 1539 1557 28 6.5 153.9 0.2X +DAY of timestamp 1032 1038 6 9.7 103.2 0.3X +DAYOFWEEK of timestamp 1241 1244 4 8.1 124.1 0.3X +DOW of timestamp 1237 1241 7 8.1 123.7 0.3X +ISODOW of timestamp 1155 1158 3 8.7 115.5 0.3X +DOY of timestamp 1075 1080 4 9.3 107.5 0.3X +HOUR of timestamp 766 770 5 13.1 76.6 0.5X +MINUTE of timestamp 764 769 4 13.1 76.4 0.5X +SECOND of timestamp 590 592 2 16.9 59.0 0.6X +MILLISECONDS of timestamp 627 636 10 16.0 62.7 0.6X +MICROSECONDS of timestamp 493 505 15 20.3 49.3 0.7X +EPOCH of timestamp 962 966 4 10.4 96.2 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 709 709 0 14.1 70.9 1.0X -MILLENNIUM of date 880 883 2 11.4 88.0 0.8X -CENTURY of date 879 884 8 11.4 87.9 0.8X -DECADE of date 873 876 2 11.4 87.3 0.8X -YEAR of date 847 848 1 11.8 84.7 0.8X -ISOYEAR of date 1054 1069 17 9.5 105.4 0.7X -QUARTER of date 996 1000 5 10.0 99.6 0.7X -MONTH of date 847 850 3 11.8 84.7 0.8X -WEEK of date 1261 1265 5 7.9 126.1 0.6X -DAY of date 849 850 1 11.8 84.9 0.8X -DAYOFWEEK of date 1028 1033 7 9.7 102.8 0.7X -DOW of date 1013 1014 2 9.9 101.3 0.7X -ISODOW of date 962 972 12 10.4 96.2 0.7X -DOY of date 881 891 17 11.3 88.1 0.8X -HOUR of date 1471 1477 5 6.8 147.1 0.5X -MINUTE of date 1456 1459 2 6.9 145.6 0.5X -SECOND of date 1390 1394 4 7.2 139.0 0.5X -MILLISECONDS of date 1390 1395 7 7.2 139.0 0.5X -MICROSECONDS of date 1266 1268 3 7.9 126.6 0.6X -EPOCH of date 1677 1679 2 6.0 167.7 0.4X +cast to date 886 905 17 11.3 88.6 1.0X +MILLENNIUM of date 1253 1261 7 8.0 125.3 0.7X +CENTURY of date 1068 1079 10 9.4 106.8 0.8X +DECADE of date 1040 1068 25 9.6 104.0 0.9X +YEAR of date 1032 1043 11 9.7 103.2 0.9X +ISOYEAR of date 1304 1313 12 7.7 130.4 0.7X +QUARTER of date 1284 1301 16 7.8 128.4 0.7X +MONTH of date 1033 1036 4 9.7 103.3 0.9X +WEEK of date 1535 1545 8 6.5 153.5 0.6X +DAY of date 1023 1033 11 9.8 102.3 0.9X +DAYOFWEEK of date 1230 1236 6 8.1 123.0 0.7X +DOW of date 1238 1247 9 8.1 123.8 0.7X +ISODOW of date 1159 1169 17 8.6 115.9 0.8X +DOY of date 1082 1084 3 9.2 108.2 0.8X +HOUR of date 1879 1891 11 5.3 187.9 0.5X +MINUTE of date 1881 1905 21 5.3 188.1 0.5X +SECOND of date 1718 1724 5 5.8 171.8 0.5X +MILLISECONDS of date 1733 1737 6 5.8 173.3 0.5X +MICROSECONDS of date 1629 1644 23 6.1 162.9 0.5X +EPOCH of date 2085 2090 5 4.8 208.5 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 704 709 4 14.2 70.4 1.0X -MILLENNIUM of date 877 879 2 11.4 87.7 0.8X -CENTURY of date 877 877 0 11.4 87.7 0.8X -DECADE of date 871 871 0 11.5 87.1 0.8X -YEAR of date 846 847 2 11.8 84.6 0.8X -ISOYEAR of date 1048 1051 5 9.5 104.8 0.7X -QUARTER of date 990 990 1 10.1 99.0 0.7X -MONTH of date 846 855 14 11.8 84.6 0.8X -WEEK of date 1225 1230 7 8.2 122.5 0.6X -DAY of date 846 847 1 11.8 84.6 0.8X -DAYOFWEEK of date 1001 1003 2 10.0 100.1 0.7X -DOW of date 998 1004 7 10.0 99.8 0.7X -ISODOW of date 956 964 11 10.5 95.6 0.7X -DOY of date 883 887 5 11.3 88.3 0.8X -HOUR of date 1463 1468 4 6.8 146.3 0.5X -MINUTE of date 1455 1457 3 6.9 145.5 0.5X -SECOND of date 1387 1392 7 7.2 138.7 0.5X -MILLISECONDS of date 1390 1400 9 7.2 139.0 0.5X -MICROSECONDS of date 1265 1268 3 7.9 126.5 0.6X -EPOCH of date 1682 1687 7 5.9 168.2 0.4X +cast to date 888 891 6 11.3 88.8 1.0X +MILLENNIUM of date 1250 1260 17 8.0 125.0 0.7X +CENTURY of date 1070 1076 6 9.3 107.0 0.8X +DECADE of date 1036 1041 5 9.6 103.6 0.9X +YEAR of date 1037 1038 1 9.6 103.7 0.9X +ISOYEAR of date 1300 1307 9 7.7 130.0 0.7X +QUARTER of date 1267 1277 9 7.9 126.7 0.7X +MONTH of date 1034 1037 4 9.7 103.4 0.9X +WEEK of date 1543 1554 10 6.5 154.3 0.6X +DAY of date 1022 1030 12 9.8 102.2 0.9X +DAYOFWEEK of date 1230 1232 4 8.1 123.0 0.7X +DOW of date 1227 1242 15 8.1 122.7 0.7X +ISODOW of date 1157 1173 20 8.6 115.7 0.8X +DOY of date 1073 1083 18 9.3 107.3 0.8X +HOUR of date 1873 1878 7 5.3 187.3 0.5X +MINUTE of date 1861 1876 14 5.4 186.1 0.5X +SECOND of date 1717 1724 6 5.8 171.7 0.5X +MILLISECONDS of date 1729 1736 7 5.8 172.9 0.5X +MICROSECONDS of date 1622 1627 5 6.2 162.2 0.5X +EPOCH of date 2066 2079 19 4.8 206.6 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to interval 944 946 2 10.6 94.4 1.0X -MILLENNIUM of interval 967 979 10 10.3 96.7 1.0X -CENTURY of interval 967 973 9 10.3 96.7 1.0X -DECADE of interval 965 966 1 10.4 96.5 1.0X -YEAR of interval 960 961 1 10.4 96.0 1.0X -QUARTER of interval 971 971 1 10.3 97.1 1.0X -MONTH of interval 990 995 6 10.1 99.0 1.0X -DAY of interval 954 955 1 10.5 95.4 1.0X -HOUR of interval 957 966 14 10.4 95.7 1.0X -MINUTE of interval 973 979 9 10.3 97.3 1.0X -SECOND of interval 1071 1088 24 9.3 107.1 0.9X -MILLISECONDS of interval 1075 1078 5 9.3 107.5 0.9X -MICROSECONDS of interval 963 967 3 10.4 96.3 1.0X -EPOCH of interval 1085 1089 5 9.2 108.5 0.9X +cast to interval 1273 1279 6 7.9 127.3 1.0X +MILLENNIUM of interval 1323 1352 36 7.6 132.3 1.0X +CENTURY of interval 1353 1356 4 7.4 135.3 0.9X +DECADE of interval 1326 1339 11 7.5 132.6 1.0X +YEAR of interval 1341 1345 3 7.5 134.1 0.9X +QUARTER of interval 1368 1372 4 7.3 136.8 0.9X +MONTH of interval 1320 1326 6 7.6 132.0 1.0X +DAY of interval 1306 1310 4 7.7 130.6 1.0X +HOUR of interval 1341 1347 8 7.5 134.1 0.9X +MINUTE of interval 1337 1349 11 7.5 133.7 1.0X +SECOND of interval 1450 1451 1 6.9 145.0 0.9X +MILLISECONDS of interval 1476 1490 23 6.8 147.6 0.9X +MICROSECONDS of interval 1316 1331 25 7.6 131.6 1.0X +EPOCH of interval 1461 1462 1 6.8 146.1 0.9X diff --git a/sql/core/benchmarks/ExtractBenchmark-results.txt b/sql/core/benchmarks/ExtractBenchmark-results.txt index f9f325f961d0d..317f107bd746c 100644 --- a/sql/core/benchmarks/ExtractBenchmark-results.txt +++ b/sql/core/benchmarks/ExtractBenchmark-results.txt @@ -1,119 +1,119 @@ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 240 265 36 41.6 24.0 1.0X -MILLENNIUM of timestamp 1021 1027 9 9.8 102.1 0.2X -CENTURY of timestamp 966 997 29 10.3 96.6 0.2X -DECADE of timestamp 874 886 11 11.4 87.4 0.3X -YEAR of timestamp 851 854 2 11.7 85.1 0.3X -ISOYEAR of timestamp 967 970 5 10.3 96.7 0.2X -QUARTER of timestamp 1047 1052 6 9.5 104.7 0.2X -MONTH of timestamp 846 848 3 11.8 84.6 0.3X -WEEK of timestamp 1237 1247 14 8.1 123.7 0.2X -DAY of timestamp 843 844 2 11.9 84.3 0.3X -DAYOFWEEK of timestamp 1005 1007 2 9.9 100.5 0.2X -DOW of timestamp 1002 1023 20 10.0 100.2 0.2X -ISODOW of timestamp 944 944 0 10.6 94.4 0.3X -DOY of timestamp 877 879 2 11.4 87.7 0.3X -HOUR of timestamp 225 233 7 44.5 22.5 1.1X -MINUTE of timestamp 228 230 2 43.9 22.8 1.1X -SECOND of timestamp 304 306 2 32.9 30.4 0.8X -MILLISECONDS of timestamp 312 315 2 32.0 31.2 0.8X -MICROSECONDS of timestamp 222 230 9 45.1 22.2 1.1X -EPOCH of timestamp 824 826 1 12.1 82.4 0.3X +cast to timestamp 409 457 45 24.5 40.9 1.0X +MILLENNIUM of timestamp 1240 1295 57 8.1 124.0 0.3X +CENTURY of timestamp 1186 1240 49 8.4 118.6 0.3X +DECADE of timestamp 1083 1104 20 9.2 108.3 0.4X +YEAR of timestamp 1061 1073 15 9.4 106.1 0.4X +ISOYEAR of timestamp 1198 1213 25 8.3 119.8 0.3X +QUARTER of timestamp 1304 1322 23 7.7 130.4 0.3X +MONTH of timestamp 1052 1067 19 9.5 105.2 0.4X +WEEK of timestamp 1534 1558 25 6.5 153.4 0.3X +DAY of timestamp 1038 1057 26 9.6 103.8 0.4X +DAYOFWEEK of timestamp 1226 1239 22 8.2 122.6 0.3X +DOW of timestamp 1212 1224 13 8.3 121.2 0.3X +ISODOW of timestamp 1148 1165 24 8.7 114.8 0.4X +DOY of timestamp 1066 1075 14 9.4 106.6 0.4X +HOUR of timestamp 358 362 6 27.9 35.8 1.1X +MINUTE of timestamp 364 369 4 27.4 36.4 1.1X +SECOND of timestamp 453 471 26 22.1 45.3 0.9X +MILLISECONDS of timestamp 497 500 2 20.1 49.7 0.8X +MICROSECONDS of timestamp 360 363 4 27.8 36.0 1.1X +EPOCH of timestamp 1100 1104 5 9.1 110.0 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 204 210 7 49.1 20.4 1.0X -MILLENNIUM of timestamp 946 950 4 10.6 94.6 0.2X -CENTURY of timestamp 942 944 2 10.6 94.2 0.2X -DECADE of timestamp 856 863 7 11.7 85.6 0.2X -YEAR of timestamp 836 837 1 12.0 83.6 0.2X -ISOYEAR of timestamp 1045 1050 8 9.6 104.5 0.2X -QUARTER of timestamp 1066 1069 3 9.4 106.6 0.2X -MONTH of timestamp 838 838 0 11.9 83.8 0.2X -WEEK of timestamp 1227 1240 12 8.2 122.7 0.2X -DAY of timestamp 831 832 2 12.0 83.1 0.2X -DAYOFWEEK of timestamp 986 989 5 10.1 98.6 0.2X -DOW of timestamp 990 991 0 10.1 99.0 0.2X -ISODOW of timestamp 939 944 7 10.7 93.9 0.2X -DOY of timestamp 871 873 2 11.5 87.1 0.2X -HOUR of timestamp 222 223 2 45.1 22.2 0.9X -MINUTE of timestamp 223 226 3 44.9 22.3 0.9X -SECOND of timestamp 292 298 5 34.2 29.2 0.7X -MILLISECONDS of timestamp 311 315 5 32.1 31.1 0.7X -MICROSECONDS of timestamp 217 218 2 46.1 21.7 0.9X -EPOCH of timestamp 815 816 2 12.3 81.5 0.3X +cast to timestamp 315 317 2 31.8 31.5 1.0X +MILLENNIUM of timestamp 1155 1162 8 8.7 115.5 0.3X +CENTURY of timestamp 1146 1152 5 8.7 114.6 0.3X +DECADE of timestamp 1031 1043 11 9.7 103.1 0.3X +YEAR of timestamp 1033 1041 10 9.7 103.3 0.3X +ISOYEAR of timestamp 1274 1278 5 7.8 127.4 0.2X +QUARTER of timestamp 1326 1346 30 7.5 132.6 0.2X +MONTH of timestamp 1027 1031 7 9.7 102.7 0.3X +WEEK of timestamp 1529 1535 6 6.5 152.9 0.2X +DAY of timestamp 1024 1031 9 9.8 102.4 0.3X +DAYOFWEEK of timestamp 1197 1201 5 8.4 119.7 0.3X +DOW of timestamp 1201 1218 15 8.3 120.1 0.3X +ISODOW of timestamp 1143 1149 6 8.8 114.3 0.3X +DOY of timestamp 1074 1085 9 9.3 107.4 0.3X +HOUR of timestamp 354 354 0 28.3 35.4 0.9X +MINUTE of timestamp 358 361 5 27.9 35.8 0.9X +SECOND of timestamp 445 456 17 22.5 44.5 0.7X +MILLISECONDS of timestamp 504 514 12 19.8 50.4 0.6X +MICROSECONDS of timestamp 361 370 8 27.7 36.1 0.9X +EPOCH of timestamp 1111 1117 9 9.0 111.1 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 690 694 5 14.5 69.0 1.0X -MILLENNIUM of date 946 948 2 10.6 94.6 0.7X -CENTURY of date 939 941 2 10.6 93.9 0.7X -DECADE of date 848 850 1 11.8 84.8 0.8X -YEAR of date 836 847 11 12.0 83.6 0.8X -ISOYEAR of date 1041 1043 3 9.6 104.1 0.7X -QUARTER of date 1062 1067 5 9.4 106.2 0.6X -MONTH of date 834 836 1 12.0 83.4 0.8X -WEEK of date 1242 1248 5 8.0 124.2 0.6X -DAY of date 831 831 1 12.0 83.1 0.8X -DAYOFWEEK of date 985 995 16 10.1 98.5 0.7X -DOW of date 989 990 2 10.1 98.9 0.7X -ISODOW of date 940 942 3 10.6 94.0 0.7X -DOY of date 870 871 2 11.5 87.0 0.8X -HOUR of date 1038 1041 3 9.6 103.8 0.7X -MINUTE of date 1030 1035 5 9.7 103.0 0.7X -SECOND of date 1137 1142 5 8.8 113.7 0.6X -MILLISECONDS of date 1159 1159 0 8.6 115.9 0.6X -MICROSECONDS of date 1043 1046 2 9.6 104.3 0.7X -EPOCH of date 1641 1645 5 6.1 164.1 0.4X +cast to date 849 851 3 11.8 84.9 1.0X +MILLENNIUM of date 1129 1139 11 8.9 112.9 0.8X +CENTURY of date 1136 1143 7 8.8 113.6 0.7X +DECADE of date 1039 1043 5 9.6 103.9 0.8X +YEAR of date 1030 1037 10 9.7 103.0 0.8X +ISOYEAR of date 1269 1278 9 7.9 126.9 0.7X +QUARTER of date 1323 1330 6 7.6 132.3 0.6X +MONTH of date 1021 1023 2 9.8 102.1 0.8X +WEEK of date 1541 1549 8 6.5 154.1 0.6X +DAY of date 1021 1033 13 9.8 102.1 0.8X +DAYOFWEEK of date 1196 1209 11 8.4 119.6 0.7X +DOW of date 1214 1229 13 8.2 121.4 0.7X +ISODOW of date 1148 1153 7 8.7 114.8 0.7X +DOY of date 1073 1079 5 9.3 107.3 0.8X +HOUR of date 1311 1314 4 7.6 131.1 0.6X +MINUTE of date 1311 1311 1 7.6 131.1 0.6X +SECOND of date 1420 1434 13 7.0 142.0 0.6X +MILLISECONDS of date 1426 1442 14 7.0 142.6 0.6X +MICROSECONDS of date 1312 1318 6 7.6 131.2 0.6X +EPOCH of date 2034 2050 16 4.9 203.4 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 689 695 10 14.5 68.9 1.0X -MILLENNIUM of date 949 951 2 10.5 94.9 0.7X -CENTURY of date 943 946 4 10.6 94.3 0.7X -DECADE of date 847 854 9 11.8 84.7 0.8X -YEAR of date 837 845 12 11.9 83.7 0.8X -ISOYEAR of date 1043 1049 9 9.6 104.3 0.7X -QUARTER of date 1122 1126 7 8.9 112.2 0.6X -MONTH of date 892 897 4 11.2 89.2 0.8X -WEEK of date 1220 1241 24 8.2 122.0 0.6X -DAY of date 829 835 8 12.1 82.9 0.8X -DAYOFWEEK of date 983 985 2 10.2 98.3 0.7X -DOW of date 988 990 1 10.1 98.8 0.7X -ISODOW of date 939 944 8 10.7 93.9 0.7X -DOY of date 868 870 2 11.5 86.8 0.8X -HOUR of date 1031 1034 2 9.7 103.1 0.7X -MINUTE of date 1037 1037 1 9.6 103.7 0.7X -SECOND of date 1130 1130 0 8.9 113.0 0.6X -MILLISECONDS of date 1145 1153 8 8.7 114.5 0.6X -MICROSECONDS of date 1040 1045 7 9.6 104.0 0.7X -EPOCH of date 1633 1634 1 6.1 163.3 0.4X +cast to date 852 879 42 11.7 85.2 1.0X +MILLENNIUM of date 1131 1136 7 8.8 113.1 0.8X +CENTURY of date 1138 1145 6 8.8 113.8 0.7X +DECADE of date 1030 1043 13 9.7 103.0 0.8X +YEAR of date 1022 1028 8 9.8 102.2 0.8X +ISOYEAR of date 1260 1265 6 7.9 126.0 0.7X +QUARTER of date 1326 1330 7 7.5 132.6 0.6X +MONTH of date 1014 1034 26 9.9 101.4 0.8X +WEEK of date 1523 1526 5 6.6 152.3 0.6X +DAY of date 1022 1023 2 9.8 102.2 0.8X +DAYOFWEEK of date 1197 1203 9 8.4 119.7 0.7X +DOW of date 1188 1198 16 8.4 118.8 0.7X +ISODOW of date 1143 1153 9 8.8 114.3 0.7X +DOY of date 1052 1058 7 9.5 105.2 0.8X +HOUR of date 1309 1311 4 7.6 130.9 0.7X +MINUTE of date 1302 1305 6 7.7 130.2 0.7X +SECOND of date 1414 1432 16 7.1 141.4 0.6X +MILLISECONDS of date 1441 1450 11 6.9 144.1 0.6X +MICROSECONDS of date 1292 1301 8 7.7 129.2 0.7X +EPOCH of date 2030 2036 8 4.9 203.0 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Invoke date_part for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to interval 926 926 1 10.8 92.6 1.0X -MILLENNIUM of interval 963 963 0 10.4 96.3 1.0X -CENTURY of interval 961 965 3 10.4 96.1 1.0X -DECADE of interval 961 964 4 10.4 96.1 1.0X -YEAR of interval 963 964 1 10.4 96.3 1.0X -QUARTER of interval 974 978 5 10.3 97.4 1.0X -MONTH of interval 965 967 2 10.4 96.5 1.0X -DAY of interval 955 964 15 10.5 95.5 1.0X -HOUR of interval 965 969 5 10.4 96.5 1.0X -MINUTE of interval 981 981 0 10.2 98.1 0.9X -SECOND of interval 1080 1082 2 9.3 108.0 0.9X -MILLISECONDS of interval 1080 1083 5 9.3 108.0 0.9X -MICROSECONDS of interval 968 969 0 10.3 96.8 1.0X -EPOCH of interval 1087 1094 10 9.2 108.7 0.9X +cast to interval 1249 1254 6 8.0 124.9 1.0X +MILLENNIUM of interval 1310 1316 9 7.6 131.0 1.0X +CENTURY of interval 1304 1315 10 7.7 130.4 1.0X +DECADE of interval 1306 1313 7 7.7 130.6 1.0X +YEAR of interval 1304 1313 11 7.7 130.4 1.0X +QUARTER of interval 1310 1317 7 7.6 131.0 1.0X +MONTH of interval 1311 1319 12 7.6 131.1 1.0X +DAY of interval 1295 1304 13 7.7 129.5 1.0X +HOUR of interval 1301 1306 8 7.7 130.1 1.0X +MINUTE of interval 1316 1319 3 7.6 131.6 0.9X +SECOND of interval 1437 1440 3 7.0 143.7 0.9X +MILLISECONDS of interval 1435 1449 16 7.0 143.5 0.9X +MICROSECONDS of interval 1304 1314 9 7.7 130.4 1.0X +EPOCH of interval 1440 1453 19 6.9 144.0 0.9X diff --git a/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt b/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt index f0f580027747c..d292607e2cbcb 100644 --- a/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt @@ -2,669 +2,669 @@ Pushdown for many distinct value case ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8552 8587 34 1.8 543.7 1.0X -Parquet Vectorized (Pushdown) 570 575 6 27.6 36.2 15.0X -Native ORC Vectorized 7377 7417 49 2.1 469.0 1.2X -Native ORC Vectorized (Pushdown) 368 376 10 42.7 23.4 23.2X +Parquet Vectorized 11943 12023 69 1.3 759.3 1.0X +Parquet Vectorized (Pushdown) 880 934 44 17.9 55.9 13.6X +Native ORC Vectorized 7847 7896 41 2.0 498.9 1.5X +Native ORC Vectorized (Pushdown) 507 525 22 31.0 32.3 23.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8688 8697 8 1.8 552.4 1.0X -Parquet Vectorized (Pushdown) 557 559 2 28.2 35.4 15.6X -Native ORC Vectorized 7472 7478 3 2.1 475.1 1.2X -Native ORC Vectorized (Pushdown) 360 366 6 43.7 22.9 24.1X +Parquet Vectorized 12020 12040 13 1.3 764.2 1.0X +Parquet Vectorized (Pushdown) 819 840 24 19.2 52.0 14.7X +Native ORC Vectorized 8045 8062 14 2.0 511.5 1.5X +Native ORC Vectorized (Pushdown) 498 535 55 31.6 31.7 24.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8663 8667 6 1.8 550.8 1.0X -Parquet Vectorized (Pushdown) 549 552 2 28.6 34.9 15.8X -Native ORC Vectorized 7516 7522 5 2.1 477.8 1.2X -Native ORC Vectorized (Pushdown) 353 356 2 44.5 22.5 24.5X +Parquet Vectorized 12006 12028 21 1.3 763.3 1.0X +Parquet Vectorized (Pushdown) 772 800 25 20.4 49.1 15.6X +Native ORC Vectorized 8074 8091 15 1.9 513.3 1.5X +Native ORC Vectorized (Pushdown) 467 481 10 33.7 29.7 25.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8679 8689 10 1.8 551.8 1.0X -Parquet Vectorized (Pushdown) 551 553 2 28.6 35.0 15.8X -Native ORC Vectorized 7508 7521 8 2.1 477.4 1.2X -Native ORC Vectorized (Pushdown) 357 360 2 44.1 22.7 24.3X +Parquet Vectorized 11995 12021 30 1.3 762.6 1.0X +Parquet Vectorized (Pushdown) 780 792 10 20.2 49.6 15.4X +Native ORC Vectorized 8046 8066 12 2.0 511.6 1.5X +Native ORC Vectorized (Pushdown) 476 489 13 33.0 30.3 25.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8681 8688 5 1.8 551.9 1.0X -Parquet Vectorized (Pushdown) 548 549 2 28.7 34.8 15.8X -Native ORC Vectorized 7502 7508 7 2.1 476.9 1.2X -Native ORC Vectorized (Pushdown) 354 355 1 44.5 22.5 24.5X +Parquet Vectorized 11967 11989 12 1.3 760.9 1.0X +Parquet Vectorized (Pushdown) 775 788 11 20.3 49.3 15.4X +Native ORC Vectorized 8028 8046 25 2.0 510.4 1.5X +Native ORC Vectorized (Pushdown) 461 493 29 34.1 29.3 26.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 17639 17660 19 0.9 1121.5 1.0X -Parquet Vectorized (Pushdown) 17816 17844 21 0.9 1132.7 1.0X -Native ORC Vectorized 16768 16788 23 0.9 1066.1 1.1X -Native ORC Vectorized (Pushdown) 16911 16939 18 0.9 1075.2 1.0X +Parquet Vectorized 21435 21513 46 0.7 1362.8 1.0X +Parquet Vectorized (Pushdown) 21710 21742 33 0.7 1380.3 1.0X +Native ORC Vectorized 19324 19373 35 0.8 1228.6 1.1X +Native ORC Vectorized (Pushdown) 19535 19572 40 0.8 1242.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8123 8135 19 1.9 516.4 1.0X -Parquet Vectorized (Pushdown) 548 550 1 28.7 34.9 14.8X -Native ORC Vectorized 6730 6748 16 2.3 427.9 1.2X -Native ORC Vectorized (Pushdown) 335 337 2 46.9 21.3 24.2X +Parquet Vectorized 11008 11034 21 1.4 699.9 1.0X +Parquet Vectorized (Pushdown) 762 767 6 20.6 48.4 14.4X +Native ORC Vectorized 7156 7186 58 2.2 454.9 1.5X +Native ORC Vectorized (Pushdown) 436 447 9 36.1 27.7 25.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8142 8156 10 1.9 517.7 1.0X -Parquet Vectorized (Pushdown) 551 553 2 28.6 35.0 14.8X -Native ORC Vectorized 6724 6726 4 2.3 427.5 1.2X -Native ORC Vectorized (Pushdown) 338 340 2 46.5 21.5 24.1X +Parquet Vectorized 10987 11033 38 1.4 698.5 1.0X +Parquet Vectorized (Pushdown) 766 776 11 20.5 48.7 14.4X +Native ORC Vectorized 7160 7192 35 2.2 455.2 1.5X +Native ORC Vectorized (Pushdown) 440 454 26 35.8 27.9 25.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8208 8210 2 1.9 521.8 1.0X -Parquet Vectorized (Pushdown) 549 550 1 28.7 34.9 15.0X -Native ORC Vectorized 6815 6827 7 2.3 433.3 1.2X -Native ORC Vectorized (Pushdown) 335 337 2 46.9 21.3 24.5X +Parquet Vectorized 11066 11082 19 1.4 703.6 1.0X +Parquet Vectorized (Pushdown) 749 770 15 21.0 47.6 14.8X +Native ORC Vectorized 7248 7294 57 2.2 460.8 1.5X +Native ORC Vectorized (Pushdown) 437 450 16 36.0 27.8 25.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8195 8206 12 1.9 521.0 1.0X -Parquet Vectorized (Pushdown) 553 554 2 28.5 35.1 14.8X -Native ORC Vectorized 6821 6824 3 2.3 433.7 1.2X -Native ORC Vectorized (Pushdown) 340 341 1 46.3 21.6 24.1X +Parquet Vectorized 11066 11091 32 1.4 703.5 1.0X +Parquet Vectorized (Pushdown) 754 776 28 20.9 47.9 14.7X +Native ORC Vectorized 7257 7265 6 2.2 461.4 1.5X +Native ORC Vectorized (Pushdown) 449 457 7 35.0 28.6 24.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8209 8213 3 1.9 521.9 1.0X -Parquet Vectorized (Pushdown) 549 556 12 28.7 34.9 15.0X -Native ORC Vectorized 6831 6834 3 2.3 434.3 1.2X -Native ORC Vectorized (Pushdown) 335 336 2 47.0 21.3 24.5X +Parquet Vectorized 11067 11079 14 1.4 703.6 1.0X +Parquet Vectorized (Pushdown) 753 762 8 20.9 47.9 14.7X +Native ORC Vectorized 7251 7267 22 2.2 461.0 1.5X +Native ORC Vectorized (Pushdown) 427 435 6 36.8 27.2 25.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8185 8189 4 1.9 520.4 1.0X -Parquet Vectorized (Pushdown) 548 549 1 28.7 34.9 14.9X -Native ORC Vectorized 6828 6866 41 2.3 434.1 1.2X -Native ORC Vectorized (Pushdown) 337 339 2 46.6 21.4 24.3X +Parquet Vectorized 11055 11086 18 1.4 702.8 1.0X +Parquet Vectorized (Pushdown) 748 753 6 21.0 47.5 14.8X +Native ORC Vectorized 7227 7253 27 2.2 459.5 1.5X +Native ORC Vectorized (Pushdown) 429 435 5 36.7 27.3 25.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9083 9089 7 1.7 577.5 1.0X -Parquet Vectorized (Pushdown) 2195 2205 6 7.2 139.6 4.1X -Native ORC Vectorized 7782 7784 2 2.0 494.8 1.2X -Native ORC Vectorized (Pushdown) 1958 1960 2 8.0 124.5 4.6X +Parquet Vectorized 12060 12091 21 1.3 766.7 1.0X +Parquet Vectorized (Pushdown) 2799 2821 17 5.6 178.0 4.3X +Native ORC Vectorized 8334 8391 55 1.9 529.9 1.4X +Native ORC Vectorized (Pushdown) 2197 2209 12 7.2 139.7 5.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 12030 12055 18 1.3 764.9 1.0X -Parquet Vectorized (Pushdown) 8332 8345 11 1.9 529.8 1.4X -Native ORC Vectorized 11210 11222 12 1.4 712.7 1.1X -Native ORC Vectorized (Pushdown) 8028 8034 5 2.0 510.4 1.5X +Parquet Vectorized 15593 15619 22 1.0 991.3 1.0X +Parquet Vectorized (Pushdown) 10573 10584 10 1.5 672.2 1.5X +Native ORC Vectorized 12276 12290 16 1.3 780.5 1.3X +Native ORC Vectorized (Pushdown) 8931 8958 31 1.8 567.8 1.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 15039 15053 12 1.0 956.2 1.0X -Parquet Vectorized (Pushdown) 14476 14492 12 1.1 920.3 1.0X -Native ORC Vectorized 14621 14638 10 1.1 929.6 1.0X -Native ORC Vectorized (Pushdown) 14095 14106 9 1.1 896.1 1.1X +Parquet Vectorized 19094 19120 23 0.8 1214.0 1.0X +Parquet Vectorized (Pushdown) 18327 18342 14 0.9 1165.2 1.0X +Native ORC Vectorized 15890 15943 44 1.0 1010.2 1.2X +Native ORC Vectorized (Pushdown) 15414 15442 24 1.0 980.0 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 15711 15745 20 1.0 998.9 1.0X -Parquet Vectorized (Pushdown) 15966 15975 8 1.0 1015.1 1.0X -Native ORC Vectorized 15372 15382 10 1.0 977.3 1.0X -Native ORC Vectorized (Pushdown) 15574 15580 6 1.0 990.2 1.0X +Parquet Vectorized 20010 20037 21 0.8 1272.2 1.0X +Parquet Vectorized (Pushdown) 20297 20318 21 0.8 1290.4 1.0X +Native ORC Vectorized 16994 17029 39 0.9 1080.5 1.2X +Native ORC Vectorized (Pushdown) 17180 17224 53 0.9 1092.3 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 15759 15775 14 1.0 1002.0 1.0X -Parquet Vectorized (Pushdown) 15987 16004 15 1.0 1016.4 1.0X -Native ORC Vectorized 15400 15422 21 1.0 979.1 1.0X -Native ORC Vectorized (Pushdown) 15571 15580 6 1.0 990.0 1.0X +Parquet Vectorized 19988 20061 96 0.8 1270.8 1.0X +Parquet Vectorized (Pushdown) 20343 20389 42 0.8 1293.4 1.0X +Native ORC Vectorized 16932 16958 22 0.9 1076.5 1.2X +Native ORC Vectorized (Pushdown) 17308 17351 31 0.9 1100.4 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 15774 15785 11 1.0 1002.9 1.0X -Parquet Vectorized (Pushdown) 16007 16017 10 1.0 1017.7 1.0X -Native ORC Vectorized 15390 15423 19 1.0 978.4 1.0X -Native ORC Vectorized (Pushdown) 15540 15574 51 1.0 988.0 1.0X +Parquet Vectorized 20167 20210 36 0.8 1282.2 1.0X +Parquet Vectorized (Pushdown) 20508 20543 44 0.8 1303.9 1.0X +Native ORC Vectorized 17038 17070 32 0.9 1083.3 1.2X +Native ORC Vectorized (Pushdown) 17250 17663 538 0.9 1096.7 1.2X ================================================================================================ Pushdown for few distinct value case (use dictionary encoding) ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7517 7529 13 2.1 477.9 1.0X -Parquet Vectorized (Pushdown) 478 479 2 32.9 30.4 15.7X -Native ORC Vectorized 8970 8973 3 1.8 570.3 0.8X -Native ORC Vectorized (Pushdown) 644 646 2 24.4 41.0 11.7X +Parquet Vectorized 10641 10674 57 1.5 676.6 1.0X +Parquet Vectorized (Pushdown) 661 665 7 23.8 42.0 16.1X +Native ORC Vectorized 9194 9227 33 1.7 584.5 1.2X +Native ORC Vectorized (Pushdown) 798 808 18 19.7 50.7 13.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7671 7679 6 2.1 487.7 1.0X -Parquet Vectorized (Pushdown) 475 476 1 33.1 30.2 16.1X -Native ORC Vectorized 9183 9188 4 1.7 583.9 0.8X -Native ORC Vectorized (Pushdown) 642 647 3 24.5 40.8 11.9X +Parquet Vectorized 10785 10810 20 1.5 685.7 1.0X +Parquet Vectorized (Pushdown) 656 666 10 24.0 41.7 16.5X +Native ORC Vectorized 9435 9457 16 1.7 599.9 1.1X +Native ORC Vectorized (Pushdown) 796 822 34 19.8 50.6 13.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7593 7599 3 2.1 482.8 1.0X -Parquet Vectorized (Pushdown) 538 539 1 29.3 34.2 14.1X -Native ORC Vectorized 9095 9099 5 1.7 578.3 0.8X -Native ORC Vectorized (Pushdown) 710 713 2 22.1 45.1 10.7X +Parquet Vectorized 10639 10664 26 1.5 676.4 1.0X +Parquet Vectorized (Pushdown) 734 742 5 21.4 46.7 14.5X +Native ORC Vectorized 9346 9362 17 1.7 594.2 1.1X +Native ORC Vectorized (Pushdown) 863 869 5 18.2 54.9 12.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7604 7608 5 2.1 483.4 1.0X -Parquet Vectorized (Pushdown) 542 544 2 29.0 34.5 14.0X -Native ORC Vectorized 9097 9102 4 1.7 578.4 0.8X -Native ORC Vectorized (Pushdown) 713 716 3 22.1 45.3 10.7X +Parquet Vectorized 10617 10672 59 1.5 675.0 1.0X +Parquet Vectorized (Pushdown) 736 747 8 21.4 46.8 14.4X +Native ORC Vectorized 9345 9445 125 1.7 594.1 1.1X +Native ORC Vectorized (Pushdown) 868 877 7 18.1 55.2 12.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7688 7695 7 2.0 488.8 1.0X -Parquet Vectorized (Pushdown) 541 544 3 29.1 34.4 14.2X -Native ORC Vectorized 9239 9243 3 1.7 587.4 0.8X -Native ORC Vectorized (Pushdown) 715 716 2 22.0 45.4 10.8X +Parquet Vectorized 10750 10790 35 1.5 683.5 1.0X +Parquet Vectorized (Pushdown) 745 748 6 21.1 47.4 14.4X +Native ORC Vectorized 9471 9488 16 1.7 602.1 1.1X +Native ORC Vectorized (Pushdown) 857 866 6 18.3 54.5 12.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 17362 17383 22 0.9 1103.8 1.0X -Parquet Vectorized (Pushdown) 17539 17579 27 0.9 1115.1 1.0X -Native ORC Vectorized 18958 19000 32 0.8 1205.3 0.9X -Native ORC Vectorized (Pushdown) 19332 19349 12 0.8 1229.1 0.9X +Parquet Vectorized 21173 21253 91 0.7 1346.1 1.0X +Parquet Vectorized (Pushdown) 21369 21456 75 0.7 1358.6 1.0X +Native ORC Vectorized 20282 20397 83 0.8 1289.5 1.0X +Native ORC Vectorized (Pushdown) 20704 20768 48 0.8 1316.3 1.0X ================================================================================================ Pushdown benchmark for StringStartsWith ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9022 9042 25 1.7 573.6 1.0X -Parquet Vectorized (Pushdown) 1373 1376 2 11.5 87.3 6.6X -Native ORC Vectorized 7828 7840 19 2.0 497.7 1.2X -Native ORC Vectorized (Pushdown) 7966 7974 13 2.0 506.4 1.1X +Parquet Vectorized 12426 12474 59 1.3 790.0 1.0X +Parquet Vectorized (Pushdown) 1847 1855 8 8.5 117.4 6.7X +Native ORC Vectorized 8336 8391 68 1.9 530.0 1.5X +Native ORC Vectorized (Pushdown) 8514 8536 14 1.8 541.3 1.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8818 8824 5 1.8 560.6 1.0X -Parquet Vectorized (Pushdown) 552 555 4 28.5 35.1 16.0X -Native ORC Vectorized 7557 7565 4 2.1 480.5 1.2X -Native ORC Vectorized (Pushdown) 7710 7712 2 2.0 490.2 1.1X +Parquet Vectorized 12143 12167 23 1.3 772.1 1.0X +Parquet Vectorized (Pushdown) 751 758 9 21.0 47.7 16.2X +Native ORC Vectorized 8064 8069 8 2.0 512.7 1.5X +Native ORC Vectorized (Pushdown) 8226 8254 35 1.9 523.0 1.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8811 8830 38 1.8 560.2 1.0X -Parquet Vectorized (Pushdown) 546 548 2 28.8 34.7 16.1X -Native ORC Vectorized 7549 7559 9 2.1 479.9 1.2X -Native ORC Vectorized (Pushdown) 7703 7712 11 2.0 489.7 1.1X +Parquet Vectorized 12123 12142 13 1.3 770.8 1.0X +Parquet Vectorized (Pushdown) 739 743 4 21.3 47.0 16.4X +Native ORC Vectorized 8038 8052 10 2.0 511.0 1.5X +Native ORC Vectorized (Pushdown) 8211 8227 12 1.9 522.0 1.5X ================================================================================================ Pushdown benchmark for decimal ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3255 3274 23 4.8 206.9 1.0X -Parquet Vectorized (Pushdown) 131 132 1 120.3 8.3 24.9X -Native ORC Vectorized 5251 5266 26 3.0 333.9 0.6X -Native ORC Vectorized (Pushdown) 119 120 2 132.0 7.6 27.3X +Parquet Vectorized 5889 5912 23 2.7 374.4 1.0X +Parquet Vectorized (Pushdown) 186 193 7 84.6 11.8 31.7X +Native ORC Vectorized 5272 5291 18 3.0 335.2 1.1X +Native ORC Vectorized (Pushdown) 156 183 36 100.9 9.9 37.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4797 4812 11 3.3 305.0 1.0X -Parquet Vectorized (Pushdown) 2304 2309 4 6.8 146.5 2.1X -Native ORC Vectorized 7041 7054 12 2.2 447.7 0.7X -Native ORC Vectorized (Pushdown) 2922 2931 6 5.4 185.8 1.6X +Parquet Vectorized 7738 7804 111 2.0 492.0 1.0X +Parquet Vectorized (Pushdown) 3172 3188 27 5.0 201.6 2.4X +Native ORC Vectorized 7522 7528 4 2.1 478.2 1.0X +Native ORC Vectorized (Pushdown) 3390 3433 35 4.6 215.5 2.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10099 10110 7 1.6 642.1 1.0X -Parquet Vectorized (Pushdown) 9713 9729 12 1.6 617.5 1.0X -Native ORC Vectorized 12905 12939 19 1.2 820.5 0.8X -Native ORC Vectorized (Pushdown) 12263 12298 37 1.3 779.6 0.8X +Parquet Vectorized 13990 14000 9 1.1 889.4 1.0X +Parquet Vectorized (Pushdown) 13251 13266 21 1.2 842.5 1.1X +Native ORC Vectorized 14799 14817 14 1.1 940.9 0.9X +Native ORC Vectorized (Pushdown) 14149 14195 64 1.1 899.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 11123 11140 15 1.4 707.2 1.0X -Parquet Vectorized (Pushdown) 11168 11185 15 1.4 710.1 1.0X -Native ORC Vectorized 14362 14417 51 1.1 913.1 0.8X -Native ORC Vectorized (Pushdown) 14381 14446 43 1.1 914.3 0.8X +Parquet Vectorized 15114 15165 44 1.0 960.9 1.0X +Parquet Vectorized (Pushdown) 15182 15222 23 1.0 965.2 1.0X +Native ORC Vectorized 16653 16683 19 0.9 1058.8 0.9X +Native ORC Vectorized (Pushdown) 16730 16743 9 0.9 1063.7 0.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3434 3452 14 4.6 218.3 1.0X -Parquet Vectorized (Pushdown) 132 134 3 118.9 8.4 26.0X -Native ORC Vectorized 5276 5282 7 3.0 335.4 0.7X -Native ORC Vectorized (Pushdown) 114 115 1 137.6 7.3 30.0X +Parquet Vectorized 6112 6127 17 2.6 388.6 1.0X +Parquet Vectorized (Pushdown) 186 190 3 84.7 11.8 32.9X +Native ORC Vectorized 5292 5359 74 3.0 336.4 1.2X +Native ORC Vectorized (Pushdown) 152 159 14 103.3 9.7 40.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4255 4284 20 3.7 270.6 1.0X -Parquet Vectorized (Pushdown) 1270 1275 3 12.4 80.7 3.4X -Native ORC Vectorized 6190 6207 13 2.5 393.6 0.7X -Native ORC Vectorized (Pushdown) 1532 1539 5 10.3 97.4 2.8X +Parquet Vectorized 7119 7158 57 2.2 452.6 1.0X +Parquet Vectorized (Pushdown) 1765 1784 13 8.9 112.2 4.0X +Native ORC Vectorized 6389 6398 11 2.5 406.2 1.1X +Native ORC Vectorized (Pushdown) 1732 1743 13 9.1 110.1 4.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7467 7476 7 2.1 474.8 1.0X -Parquet Vectorized (Pushdown) 5806 5824 15 2.7 369.1 1.3X -Native ORC Vectorized 9725 9757 36 1.6 618.3 0.8X -Native ORC Vectorized (Pushdown) 7157 7209 29 2.2 455.0 1.0X +Parquet Vectorized 10996 11025 19 1.4 699.1 1.0X +Parquet Vectorized (Pushdown) 8047 8074 16 2.0 511.6 1.4X +Native ORC Vectorized 10620 10642 23 1.5 675.2 1.0X +Native ORC Vectorized (Pushdown) 8086 8102 14 1.9 514.1 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10521 10538 9 1.5 668.9 1.0X -Parquet Vectorized (Pushdown) 10243 10263 19 1.5 651.3 1.0X -Native ORC Vectorized 13198 13224 28 1.2 839.1 0.8X -Native ORC Vectorized (Pushdown) 12706 12769 59 1.2 807.8 0.8X +Parquet Vectorized 14800 14834 28 1.1 941.0 1.0X +Parquet Vectorized (Pushdown) 14261 14268 7 1.1 906.7 1.0X +Native ORC Vectorized 14832 14880 44 1.1 943.0 1.0X +Native ORC Vectorized (Pushdown) 14402 14428 28 1.1 915.7 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 5087 5106 12 3.1 323.4 1.0X -Parquet Vectorized (Pushdown) 145 146 1 108.7 9.2 35.1X -Native ORC Vectorized 5281 5290 6 3.0 335.8 1.0X -Native ORC Vectorized (Pushdown) 114 115 1 137.7 7.3 44.5X +Parquet Vectorized 8132 8178 36 1.9 517.0 1.0X +Parquet Vectorized (Pushdown) 201 209 10 78.3 12.8 40.5X +Native ORC Vectorized 5270 5290 16 3.0 335.0 1.5X +Native ORC Vectorized (Pushdown) 149 153 2 105.2 9.5 54.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 6173 6188 9 2.5 392.5 1.0X -Parquet Vectorized (Pushdown) 1677 1696 12 9.4 106.6 3.7X -Native ORC Vectorized 6351 6366 12 2.5 403.8 1.0X -Native ORC Vectorized (Pushdown) 1662 1676 11 9.5 105.7 3.7X +Parquet Vectorized 9422 9465 50 1.7 599.1 1.0X +Parquet Vectorized (Pushdown) 2271 2283 13 6.9 144.4 4.1X +Native ORC Vectorized 6651 6662 10 2.4 422.9 1.4X +Native ORC Vectorized (Pushdown) 2002 2016 17 7.9 127.3 4.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10529 10610 87 1.5 669.4 1.0X -Parquet Vectorized (Pushdown) 7918 8076 90 2.0 503.4 1.3X -Native ORC Vectorized 10450 10483 21 1.5 664.4 1.0X -Native ORC Vectorized (Pushdown) 7913 7918 4 2.0 503.1 1.3X +Parquet Vectorized 14781 14814 37 1.1 939.7 1.0X +Parquet Vectorized (Pushdown) 10675 10696 24 1.5 678.7 1.4X +Native ORC Vectorized 11887 11983 101 1.3 755.8 1.2X +Native ORC Vectorized (Pushdown) 9383 9396 11 1.7 596.5 1.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 14695 14774 49 1.1 934.3 1.0X -Parquet Vectorized (Pushdown) 14151 14271 103 1.1 899.7 1.0X -Native ORC Vectorized 14511 14538 24 1.1 922.6 1.0X -Native ORC Vectorized (Pushdown) 14046 14070 19 1.1 893.0 1.0X +Parquet Vectorized 19753 19777 28 0.8 1255.9 1.0X +Parquet Vectorized (Pushdown) 19049 19089 49 0.8 1211.1 1.0X +Native ORC Vectorized 17238 17247 7 0.9 1096.0 1.1X +Native ORC Vectorized (Pushdown) 16780 16804 21 0.9 1066.9 1.2X ================================================================================================ Pushdown benchmark for InSet -> InFilters ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8214 8226 17 1.9 522.2 1.0X -Parquet Vectorized (Pushdown) 567 567 1 27.7 36.0 14.5X -Native ORC Vectorized 6989 7000 17 2.3 444.3 1.2X -Native ORC Vectorized (Pushdown) 352 354 3 44.7 22.4 23.3X +Parquet Vectorized 11101 11144 74 1.4 705.8 1.0X +Parquet Vectorized (Pushdown) 773 776 3 20.3 49.1 14.4X +Native ORC Vectorized 6973 7001 28 2.3 443.3 1.6X +Native ORC Vectorized (Pushdown) 445 451 5 35.4 28.3 25.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8218 8219 1 1.9 522.5 1.0X -Parquet Vectorized (Pushdown) 568 569 1 27.7 36.1 14.5X -Native ORC Vectorized 6955 6959 3 2.3 442.2 1.2X -Native ORC Vectorized (Pushdown) 354 355 1 44.4 22.5 23.2X +Parquet Vectorized 11098 11111 13 1.4 705.6 1.0X +Parquet Vectorized (Pushdown) 775 778 4 20.3 49.2 14.3X +Native ORC Vectorized 6980 6996 9 2.3 443.8 1.6X +Native ORC Vectorized (Pushdown) 441 448 8 35.7 28.0 25.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8217 8225 11 1.9 522.4 1.0X -Parquet Vectorized (Pushdown) 567 568 2 27.7 36.1 14.5X -Native ORC Vectorized 6959 6968 10 2.3 442.5 1.2X -Native ORC Vectorized (Pushdown) 355 356 1 44.4 22.5 23.2X +Parquet Vectorized 11089 11118 26 1.4 705.0 1.0X +Parquet Vectorized (Pushdown) 772 777 3 20.4 49.1 14.4X +Native ORC Vectorized 6973 6985 9 2.3 443.3 1.6X +Native ORC Vectorized (Pushdown) 446 448 3 35.3 28.3 24.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8244 8251 5 1.9 524.1 1.0X -Parquet Vectorized (Pushdown) 593 594 1 26.5 37.7 13.9X -Native ORC Vectorized 7006 7013 5 2.2 445.5 1.2X -Native ORC Vectorized (Pushdown) 369 373 5 42.6 23.5 22.3X +Parquet Vectorized 11113 11137 19 1.4 706.5 1.0X +Parquet Vectorized (Pushdown) 802 807 5 19.6 51.0 13.9X +Native ORC Vectorized 7034 7080 63 2.2 447.2 1.6X +Native ORC Vectorized (Pushdown) 461 469 5 34.1 29.3 24.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8231 8236 3 1.9 523.3 1.0X -Parquet Vectorized (Pushdown) 593 595 2 26.5 37.7 13.9X -Native ORC Vectorized 7041 7048 4 2.2 447.6 1.2X -Native ORC Vectorized (Pushdown) 378 379 1 41.6 24.0 21.8X +Parquet Vectorized 11122 11134 16 1.4 707.1 1.0X +Parquet Vectorized (Pushdown) 804 817 16 19.6 51.1 13.8X +Native ORC Vectorized 7027 7037 10 2.2 446.8 1.6X +Native ORC Vectorized (Pushdown) 463 470 5 34.0 29.4 24.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8242 8245 4 1.9 524.0 1.0X -Parquet Vectorized (Pushdown) 594 596 2 26.5 37.8 13.9X -Native ORC Vectorized 7026 7036 9 2.2 446.7 1.2X -Native ORC Vectorized (Pushdown) 379 383 6 41.5 24.1 21.8X +Parquet Vectorized 11097 11115 13 1.4 705.5 1.0X +Parquet Vectorized (Pushdown) 804 810 6 19.6 51.1 13.8X +Native ORC Vectorized 7010 7022 15 2.2 445.7 1.6X +Native ORC Vectorized (Pushdown) 465 468 4 33.8 29.6 23.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8504 8514 6 1.8 540.7 1.0X -Parquet Vectorized (Pushdown) 8694 8697 2 1.8 552.7 1.0X -Native ORC Vectorized 7307 7314 6 2.2 464.6 1.2X -Native ORC Vectorized (Pushdown) 534 536 4 29.5 33.9 15.9X +Parquet Vectorized 11378 11387 7 1.4 723.4 1.0X +Parquet Vectorized (Pushdown) 11640 11675 37 1.4 740.1 1.0X +Native ORC Vectorized 7266 7284 24 2.2 462.0 1.6X +Native ORC Vectorized (Pushdown) 612 624 12 25.7 38.9 18.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8556 8568 8 1.8 544.0 1.0X -Parquet Vectorized (Pushdown) 8764 8766 2 1.8 557.2 1.0X -Native ORC Vectorized 7304 7311 9 2.2 464.4 1.2X -Native ORC Vectorized (Pushdown) 560 560 1 28.1 35.6 15.3X +Parquet Vectorized 11411 11448 49 1.4 725.5 1.0X +Parquet Vectorized (Pushdown) 11670 11692 20 1.3 741.9 1.0X +Native ORC Vectorized 7284 7292 10 2.2 463.1 1.6X +Native ORC Vectorized (Pushdown) 652 659 8 24.1 41.4 17.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8518 8528 8 1.8 541.6 1.0X -Parquet Vectorized (Pushdown) 8729 8758 53 1.8 554.9 1.0X -Native ORC Vectorized 7291 7293 2 2.2 463.5 1.2X -Native ORC Vectorized (Pushdown) 561 562 1 28.0 35.7 15.2X +Parquet Vectorized 11399 11447 71 1.4 724.7 1.0X +Parquet Vectorized (Pushdown) 11659 11684 15 1.3 741.3 1.0X +Native ORC Vectorized 7290 7301 10 2.2 463.5 1.6X +Native ORC Vectorized (Pushdown) 655 700 77 24.0 41.7 17.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8492 8500 9 1.9 539.9 1.0X -Parquet Vectorized (Pushdown) 8702 8705 3 1.8 553.3 1.0X -Native ORC Vectorized 7270 7276 6 2.2 462.2 1.2X -Native ORC Vectorized (Pushdown) 701 702 1 22.4 44.6 12.1X +Parquet Vectorized 11398 11424 23 1.4 724.7 1.0X +Parquet Vectorized (Pushdown) 11660 11775 100 1.3 741.3 1.0X +Native ORC Vectorized 7292 7312 24 2.2 463.6 1.6X +Native ORC Vectorized (Pushdown) 789 796 5 19.9 50.2 14.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 100, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8499 8502 3 1.9 540.4 1.0X -Parquet Vectorized (Pushdown) 8704 8709 4 1.8 553.4 1.0X -Native ORC Vectorized 7274 7276 3 2.2 462.5 1.2X -Native ORC Vectorized (Pushdown) 774 775 1 20.3 49.2 11.0X +Parquet Vectorized 11399 11462 55 1.4 724.7 1.0X +Parquet Vectorized (Pushdown) 11648 11670 24 1.4 740.6 1.0X +Native ORC Vectorized 7254 7265 8 2.2 461.2 1.6X +Native ORC Vectorized (Pushdown) 851 857 5 18.5 54.1 13.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 100, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8505 8512 10 1.8 540.8 1.0X -Parquet Vectorized (Pushdown) 8716 8728 12 1.8 554.2 1.0X -Native ORC Vectorized 7271 7289 11 2.2 462.3 1.2X -Native ORC Vectorized (Pushdown) 784 786 1 20.1 49.9 10.8X +Parquet Vectorized 11383 11499 97 1.4 723.7 1.0X +Parquet Vectorized (Pushdown) 11694 11731 22 1.3 743.5 1.0X +Native ORC Vectorized 7244 7272 22 2.2 460.6 1.6X +Native ORC Vectorized (Pushdown) 887 896 12 17.7 56.4 12.8X ================================================================================================ Pushdown benchmark for tinyint ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 tinyint row (value = CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3609 3615 5 4.4 229.5 1.0X -Parquet Vectorized (Pushdown) 177 178 2 88.8 11.3 20.4X -Native ORC Vectorized 3352 3360 8 4.7 213.1 1.1X -Native ORC Vectorized (Pushdown) 175 175 1 90.0 11.1 20.7X +Parquet Vectorized 6301 6337 24 2.5 400.6 1.0X +Parquet Vectorized (Pushdown) 254 260 4 61.9 16.2 24.8X +Native ORC Vectorized 3257 3273 12 4.8 207.1 1.9X +Native ORC Vectorized (Pushdown) 211 217 4 74.4 13.4 29.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% tinyint rows (value < CAST(12 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4333 4344 17 3.6 275.5 1.0X -Parquet Vectorized (Pushdown) 1206 1209 3 13.0 76.7 3.6X -Native ORC Vectorized 4127 4137 7 3.8 262.4 1.0X -Native ORC Vectorized (Pushdown) 1245 1252 7 12.6 79.2 3.5X +Parquet Vectorized 7169 7219 46 2.2 455.8 1.0X +Parquet Vectorized (Pushdown) 1665 1672 12 9.4 105.9 4.3X +Native ORC Vectorized 4199 4208 12 3.7 267.0 1.7X +Native ORC Vectorized (Pushdown) 1376 1394 30 11.4 87.5 5.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% tinyint rows (value < CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7295 7312 14 2.2 463.8 1.0X -Parquet Vectorized (Pushdown) 5576 5587 12 2.8 354.5 1.3X -Native ORC Vectorized 8886 8894 6 1.8 565.0 0.8X -Native ORC Vectorized (Pushdown) 7293 7309 11 2.2 463.7 1.0X +Parquet Vectorized 10703 10739 29 1.5 680.5 1.0X +Parquet Vectorized (Pushdown) 7648 7671 20 2.1 486.3 1.4X +Native ORC Vectorized 7815 7836 14 2.0 496.9 1.4X +Native ORC Vectorized (Pushdown) 6289 6295 9 2.5 399.8 1.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% tinyint rows (value < CAST(114 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10214 10230 14 1.5 649.4 1.0X -Parquet Vectorized (Pushdown) 9917 9930 11 1.6 630.5 1.0X -Native ORC Vectorized 10610 10618 9 1.5 674.5 1.0X -Native ORC Vectorized (Pushdown) 10352 10355 3 1.5 658.1 1.0X +Parquet Vectorized 14239 14284 35 1.1 905.3 1.0X +Parquet Vectorized (Pushdown) 13733 13769 28 1.1 873.1 1.0X +Native ORC Vectorized 11432 11481 32 1.4 726.8 1.2X +Native ORC Vectorized (Pushdown) 11241 11254 11 1.4 714.7 1.3X ================================================================================================ Pushdown benchmark for Timestamp ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 timestamp stored as INT96 row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4053 4057 3 3.9 257.7 1.0X -Parquet Vectorized (Pushdown) 4106 4111 4 3.8 261.1 1.0X -Native ORC Vectorized 3232 3236 4 4.9 205.5 1.3X -Native ORC Vectorized (Pushdown) 96 97 1 163.9 6.1 42.2X +Parquet Vectorized 6805 6823 17 2.3 432.7 1.0X +Parquet Vectorized (Pushdown) 6876 6892 11 2.3 437.2 1.0X +Native ORC Vectorized 3186 3208 33 4.9 202.5 2.1X +Native ORC Vectorized (Pushdown) 131 140 9 120.4 8.3 52.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% timestamp stored as INT96 rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4849 4856 9 3.2 308.3 1.0X -Parquet Vectorized (Pushdown) 4896 4897 2 3.2 311.3 1.0X -Native ORC Vectorized 4072 4083 10 3.9 258.9 1.2X -Native ORC Vectorized (Pushdown) 1270 1274 5 12.4 80.8 3.8X +Parquet Vectorized 7742 7765 21 2.0 492.2 1.0X +Parquet Vectorized (Pushdown) 7798 7853 70 2.0 495.8 1.0X +Native ORC Vectorized 4128 4138 8 3.8 262.4 1.9X +Native ORC Vectorized (Pushdown) 1392 1402 17 11.3 88.5 5.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% timestamp stored as INT96 rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7995 8007 9 2.0 508.3 1.0X -Parquet Vectorized (Pushdown) 8024 8033 5 2.0 510.2 1.0X -Native ORC Vectorized 7398 7409 10 2.1 470.3 1.1X -Native ORC Vectorized (Pushdown) 5844 5862 14 2.7 371.6 1.4X +Parquet Vectorized 11354 11380 33 1.4 721.9 1.0X +Parquet Vectorized (Pushdown) 11408 11449 36 1.4 725.3 1.0X +Native ORC Vectorized 7752 7780 26 2.0 492.8 1.5X +Native ORC Vectorized (Pushdown) 6233 6246 12 2.5 396.3 1.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% timestamp stored as INT96 rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 11045 11062 15 1.4 702.3 1.0X -Parquet Vectorized (Pushdown) 11075 11087 11 1.4 704.1 1.0X -Native ORC Vectorized 10627 10658 21 1.5 675.7 1.0X -Native ORC Vectorized (Pushdown) 10373 10417 46 1.5 659.5 1.1X +Parquet Vectorized 14944 14997 49 1.1 950.1 1.0X +Parquet Vectorized (Pushdown) 15066 15120 95 1.0 957.9 1.0X +Native ORC Vectorized 11422 11487 45 1.4 726.2 1.3X +Native ORC Vectorized (Pushdown) 11169 11211 30 1.4 710.1 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 timestamp stored as TIMESTAMP_MICROS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3359 3379 12 4.7 213.6 1.0X -Parquet Vectorized (Pushdown) 132 132 1 119.5 8.4 25.5X -Native ORC Vectorized 3222 3227 4 4.9 204.9 1.0X -Native ORC Vectorized (Pushdown) 95 97 6 165.1 6.1 35.3X +Parquet Vectorized 6047 6083 28 2.6 384.5 1.0X +Parquet Vectorized (Pushdown) 188 192 3 83.5 12.0 32.1X +Native ORC Vectorized 3169 3180 11 5.0 201.5 1.9X +Native ORC Vectorized (Pushdown) 127 138 15 124.0 8.1 47.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4187 4213 18 3.8 266.2 1.0X -Parquet Vectorized (Pushdown) 1300 1304 3 12.1 82.6 3.2X -Native ORC Vectorized 4074 4077 3 3.9 259.0 1.0X -Native ORC Vectorized (Pushdown) 1271 1275 4 12.4 80.8 3.3X +Parquet Vectorized 6967 7009 26 2.3 443.0 1.0X +Parquet Vectorized (Pushdown) 1705 1711 7 9.2 108.4 4.1X +Native ORC Vectorized 4092 4115 18 3.8 260.2 1.7X +Native ORC Vectorized (Pushdown) 1389 1394 9 11.3 88.3 5.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7450 7466 11 2.1 473.6 1.0X -Parquet Vectorized (Pushdown) 5858 5876 14 2.7 372.5 1.3X -Native ORC Vectorized 7421 7436 18 2.1 471.8 1.0X -Native ORC Vectorized (Pushdown) 5852 5875 15 2.7 372.0 1.3X +Parquet Vectorized 10658 10695 23 1.5 677.6 1.0X +Parquet Vectorized (Pushdown) 7760 7792 35 2.0 493.4 1.4X +Native ORC Vectorized 7780 7802 24 2.0 494.6 1.4X +Native ORC Vectorized (Pushdown) 6241 6279 24 2.5 396.8 1.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10373 10416 24 1.5 659.5 1.0X -Parquet Vectorized (Pushdown) 10081 10119 25 1.6 641.0 1.0X -Native ORC Vectorized 10641 10653 8 1.5 676.5 1.0X -Native ORC Vectorized (Pushdown) 10373 10396 22 1.5 659.5 1.0X +Parquet Vectorized 14209 14253 53 1.1 903.4 1.0X +Parquet Vectorized (Pushdown) 13742 13764 15 1.1 873.7 1.0X +Native ORC Vectorized 11437 11463 18 1.4 727.1 1.2X +Native ORC Vectorized (Pushdown) 11172 11218 43 1.4 710.3 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3661 3680 14 4.3 232.7 1.0X -Parquet Vectorized (Pushdown) 132 132 1 119.3 8.4 27.8X -Native ORC Vectorized 3223 3226 5 4.9 204.9 1.1X -Native ORC Vectorized (Pushdown) 95 96 1 165.3 6.0 38.5X +Parquet Vectorized 6124 6173 46 2.6 389.4 1.0X +Parquet Vectorized (Pushdown) 187 189 3 84.2 11.9 32.8X +Native ORC Vectorized 3161 3174 13 5.0 200.9 1.9X +Native ORC Vectorized (Pushdown) 129 144 24 122.4 8.2 47.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4510 4518 7 3.5 286.8 1.0X -Parquet Vectorized (Pushdown) 1336 1342 6 11.8 84.9 3.4X -Native ORC Vectorized 4074 4079 5 3.9 259.0 1.1X -Native ORC Vectorized (Pushdown) 1273 1276 3 12.4 80.9 3.5X +Parquet Vectorized 7068 7094 23 2.2 449.4 1.0X +Parquet Vectorized (Pushdown) 1724 1740 19 9.1 109.6 4.1X +Native ORC Vectorized 4127 4137 12 3.8 262.4 1.7X +Native ORC Vectorized (Pushdown) 1385 1393 10 11.4 88.1 5.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7753 7771 14 2.0 492.9 1.0X -Parquet Vectorized (Pushdown) 6003 6016 9 2.6 381.7 1.3X -Native ORC Vectorized 7402 7421 15 2.1 470.6 1.0X -Native ORC Vectorized (Pushdown) 5849 5862 15 2.7 371.9 1.3X +Parquet Vectorized 10767 10786 21 1.5 684.5 1.0X +Parquet Vectorized (Pushdown) 7805 7820 13 2.0 496.2 1.4X +Native ORC Vectorized 7714 7775 64 2.0 490.4 1.4X +Native ORC Vectorized (Pushdown) 6247 6266 17 2.5 397.2 1.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10604 10657 31 1.5 674.2 1.0X -Parquet Vectorized (Pushdown) 10361 10396 31 1.5 658.7 1.0X -Native ORC Vectorized 10647 10664 10 1.5 676.9 1.0X -Native ORC Vectorized (Pushdown) 10369 10382 10 1.5 659.3 1.0X +Parquet Vectorized 14337 14392 34 1.1 911.5 1.0X +Parquet Vectorized (Pushdown) 13774 13791 13 1.1 875.7 1.0X +Native ORC Vectorized 11426 11448 16 1.4 726.4 1.3X +Native ORC Vectorized (Pushdown) 11149 11181 27 1.4 708.8 1.3X ================================================================================================ Pushdown benchmark with many filters ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 row with 1 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 393 395 3 0.0 393378701.0 1.0X -Parquet Vectorized (Pushdown) 397 398 2 0.0 396672156.0 1.0X -Native ORC Vectorized 379 380 1 0.0 378742694.0 1.0X -Native ORC Vectorized (Pushdown) 379 380 1 0.0 378798661.0 1.0X +Parquet Vectorized 509 514 6 0.0 509244147.0 1.0X +Parquet Vectorized (Pushdown) 512 519 6 0.0 511810881.0 1.0X +Native ORC Vectorized 488 495 8 0.0 488404846.0 1.0X +Native ORC Vectorized (Pushdown) 489 500 16 0.0 489064429.0 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 row with 250 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 1269 1270 2 0.0 1268825411.0 1.0X -Parquet Vectorized (Pushdown) 1350 1352 1 0.0 1350249380.0 0.9X -Native ORC Vectorized 1251 1252 1 0.0 1250530925.0 1.0X -Native ORC Vectorized (Pushdown) 1257 1258 2 0.0 1256686542.0 1.0X +Parquet Vectorized 1704 1712 7 0.0 1703741457.0 1.0X +Parquet Vectorized (Pushdown) 1782 1794 7 0.0 1781727704.0 1.0X +Native ORC Vectorized 1668 1674 5 0.0 1668306343.0 1.0X +Native ORC Vectorized (Pushdown) 1670 1679 7 0.0 1669592413.0 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 row with 500 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3586 3597 14 0.0 3585798791.0 1.0X -Parquet Vectorized (Pushdown) 3874 3878 6 0.0 3874055410.0 0.9X -Native ORC Vectorized 3576 3581 4 0.0 3575722138.0 1.0X -Native ORC Vectorized (Pushdown) 3590 3594 4 0.0 3589903482.0 1.0X +Parquet Vectorized 5011 5044 25 0.0 5011180244.0 1.0X +Parquet Vectorized (Pushdown) 5375 5397 17 0.0 5375351637.0 0.9X +Native ORC Vectorized 4979 4992 12 0.0 4979326800.0 1.0X +Native ORC Vectorized (Pushdown) 4979 5008 26 0.0 4978952429.0 1.0X diff --git a/sql/core/benchmarks/FilterPushdownBenchmark-results.txt b/sql/core/benchmarks/FilterPushdownBenchmark-results.txt index 6bee8cbfc7d7a..1fda7bffc8e82 100644 --- a/sql/core/benchmarks/FilterPushdownBenchmark-results.txt +++ b/sql/core/benchmarks/FilterPushdownBenchmark-results.txt @@ -2,669 +2,669 @@ Pushdown for many distinct value case ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7663 7681 25 2.1 487.2 1.0X -Parquet Vectorized (Pushdown) 484 494 15 32.5 30.8 15.8X -Native ORC Vectorized 5930 5968 46 2.7 377.0 1.3X -Native ORC Vectorized (Pushdown) 320 334 20 49.2 20.3 24.0X +Parquet Vectorized 9582 9636 49 1.6 609.2 1.0X +Parquet Vectorized (Pushdown) 759 785 40 20.7 48.3 12.6X +Native ORC Vectorized 7141 7183 60 2.2 454.0 1.3X +Native ORC Vectorized (Pushdown) 513 556 49 30.7 32.6 18.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7788 7796 5 2.0 495.1 1.0X -Parquet Vectorized (Pushdown) 472 474 3 33.3 30.0 16.5X -Native ORC Vectorized 6071 6074 4 2.6 386.0 1.3X -Native ORC Vectorized (Pushdown) 311 323 17 50.5 19.8 25.0X +Parquet Vectorized 9657 9675 22 1.6 614.0 1.0X +Parquet Vectorized (Pushdown) 707 724 26 22.2 44.9 13.7X +Native ORC Vectorized 7250 7296 49 2.2 460.9 1.3X +Native ORC Vectorized (Pushdown) 503 537 51 31.3 32.0 19.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7775 7784 10 2.0 494.3 1.0X -Parquet Vectorized (Pushdown) 464 468 6 33.9 29.5 16.7X -Native ORC Vectorized 6083 6090 6 2.6 386.7 1.3X -Native ORC Vectorized (Pushdown) 304 316 17 51.8 19.3 25.6X +Parquet Vectorized 9636 9657 20 1.6 612.7 1.0X +Parquet Vectorized (Pushdown) 679 693 13 23.2 43.2 14.2X +Native ORC Vectorized 7327 7359 25 2.1 465.8 1.3X +Native ORC Vectorized (Pushdown) 483 512 30 32.6 30.7 20.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7782 7788 7 2.0 494.8 1.0X -Parquet Vectorized (Pushdown) 469 477 13 33.5 29.8 16.6X -Native ORC Vectorized 6092 6108 9 2.6 387.3 1.3X -Native ORC Vectorized (Pushdown) 308 319 16 51.0 19.6 25.3X +Parquet Vectorized 9688 9710 29 1.6 615.9 1.0X +Parquet Vectorized (Pushdown) 674 692 14 23.3 42.8 14.4X +Native ORC Vectorized 7315 7343 22 2.2 465.1 1.3X +Native ORC Vectorized (Pushdown) 483 498 24 32.6 30.7 20.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7751 7762 10 2.0 492.8 1.0X -Parquet Vectorized (Pushdown) 464 467 2 33.9 29.5 16.7X -Native ORC Vectorized 6040 6049 9 2.6 384.0 1.3X -Native ORC Vectorized (Pushdown) 304 314 16 51.7 19.3 25.5X +Parquet Vectorized 9611 9638 21 1.6 611.1 1.0X +Parquet Vectorized (Pushdown) 670 676 4 23.5 42.6 14.3X +Native ORC Vectorized 7261 7313 31 2.2 461.6 1.3X +Native ORC Vectorized (Pushdown) 480 518 51 32.8 30.5 20.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 15312 15346 23 1.0 973.5 1.0X -Parquet Vectorized (Pushdown) 15492 15501 8 1.0 985.0 1.0X -Native ORC Vectorized 14083 14097 12 1.1 895.4 1.1X -Native ORC Vectorized (Pushdown) 14207 14232 18 1.1 903.3 1.1X +Parquet Vectorized 18597 18738 91 0.8 1182.4 1.0X +Parquet Vectorized (Pushdown) 18864 18915 30 0.8 1199.4 1.0X +Native ORC Vectorized 16865 16968 67 0.9 1072.3 1.1X +Native ORC Vectorized (Pushdown) 17056 17168 120 0.9 1084.4 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7239 7250 19 2.2 460.3 1.0X -Parquet Vectorized (Pushdown) 459 464 4 34.3 29.2 15.8X -Native ORC Vectorized 5407 5419 16 2.9 343.8 1.3X -Native ORC Vectorized (Pushdown) 291 303 20 54.0 18.5 24.9X +Parquet Vectorized 8923 8981 48 1.8 567.3 1.0X +Parquet Vectorized (Pushdown) 651 670 25 24.1 41.4 13.7X +Native ORC Vectorized 6477 6507 46 2.4 411.8 1.4X +Native ORC Vectorized (Pushdown) 453 470 26 34.7 28.8 19.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7265 7269 5 2.2 461.9 1.0X -Parquet Vectorized (Pushdown) 461 468 9 34.1 29.3 15.8X -Native ORC Vectorized 5415 5421 4 2.9 344.3 1.3X -Native ORC Vectorized (Pushdown) 292 303 17 53.9 18.6 24.9X +Parquet Vectorized 8979 8989 12 1.8 570.9 1.0X +Parquet Vectorized (Pushdown) 659 674 15 23.9 41.9 13.6X +Native ORC Vectorized 6502 6522 13 2.4 413.4 1.4X +Native ORC Vectorized (Pushdown) 460 479 22 34.2 29.2 19.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7286 7293 5 2.2 463.2 1.0X -Parquet Vectorized (Pushdown) 459 461 3 34.3 29.2 15.9X -Native ORC Vectorized 5487 5492 3 2.9 348.9 1.3X -Native ORC Vectorized (Pushdown) 291 301 17 54.1 18.5 25.1X +Parquet Vectorized 9046 9065 23 1.7 575.1 1.0X +Parquet Vectorized (Pushdown) 654 662 9 24.1 41.6 13.8X +Native ORC Vectorized 6592 6617 24 2.4 419.1 1.4X +Native ORC Vectorized (Pushdown) 450 468 20 34.9 28.6 20.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7292 7294 2 2.2 463.6 1.0X -Parquet Vectorized (Pushdown) 462 464 3 34.0 29.4 15.8X -Native ORC Vectorized 5485 5502 11 2.9 348.7 1.3X -Native ORC Vectorized (Pushdown) 296 307 17 53.2 18.8 24.7X +Parquet Vectorized 9036 9052 16 1.7 574.5 1.0X +Parquet Vectorized (Pushdown) 652 661 9 24.1 41.5 13.9X +Native ORC Vectorized 6566 6616 36 2.4 417.4 1.4X +Native ORC Vectorized (Pushdown) 456 493 47 34.5 29.0 19.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7280 7297 10 2.2 462.8 1.0X -Parquet Vectorized (Pushdown) 460 462 2 34.2 29.3 15.8X -Native ORC Vectorized 5468 5471 3 2.9 347.6 1.3X -Native ORC Vectorized (Pushdown) 293 304 17 53.7 18.6 24.9X +Parquet Vectorized 9024 9062 52 1.7 573.7 1.0X +Parquet Vectorized (Pushdown) 657 662 4 23.9 41.8 13.7X +Native ORC Vectorized 6575 6606 19 2.4 418.1 1.4X +Native ORC Vectorized (Pushdown) 454 464 15 34.6 28.9 19.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7298 7299 1 2.2 464.0 1.0X -Parquet Vectorized (Pushdown) 459 462 3 34.3 29.2 15.9X -Native ORC Vectorized 5465 5475 8 2.9 347.5 1.3X -Native ORC Vectorized (Pushdown) 290 300 17 54.3 18.4 25.2X +Parquet Vectorized 8992 9012 18 1.7 571.7 1.0X +Parquet Vectorized (Pushdown) 651 656 4 24.2 41.4 13.8X +Native ORC Vectorized 6615 6622 5 2.4 420.6 1.4X +Native ORC Vectorized (Pushdown) 455 467 22 34.5 29.0 19.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8107 8115 5 1.9 515.5 1.0X -Parquet Vectorized (Pushdown) 1974 1976 2 8.0 125.5 4.1X -Native ORC Vectorized 6373 6382 9 2.5 405.2 1.3X -Native ORC Vectorized (Pushdown) 1698 1705 4 9.3 108.0 4.8X +Parquet Vectorized 9928 9972 49 1.6 631.2 1.0X +Parquet Vectorized (Pushdown) 2416 2427 11 6.5 153.6 4.1X +Native ORC Vectorized 7620 7650 21 2.1 484.5 1.3X +Native ORC Vectorized (Pushdown) 2094 2161 119 7.5 133.1 4.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10937 10950 9 1.4 695.4 1.0X -Parquet Vectorized (Pushdown) 7601 7604 2 2.1 483.3 1.4X -Native ORC Vectorized 9461 9484 45 1.7 601.5 1.2X -Native ORC Vectorized (Pushdown) 6914 6924 7 2.3 439.6 1.6X +Parquet Vectorized 13110 13154 46 1.2 833.5 1.0X +Parquet Vectorized (Pushdown) 9096 9130 34 1.7 578.3 1.4X +Native ORC Vectorized 11109 11139 21 1.4 706.3 1.2X +Native ORC Vectorized (Pushdown) 8100 8158 40 1.9 515.0 1.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 13761 13774 9 1.1 874.9 1.0X -Parquet Vectorized (Pushdown) 13261 13265 3 1.2 843.1 1.0X -Native ORC Vectorized 12517 12532 9 1.3 795.8 1.1X -Native ORC Vectorized (Pushdown) 12141 12144 2 1.3 771.9 1.1X +Parquet Vectorized 16372 16424 53 1.0 1040.9 1.0X +Parquet Vectorized (Pushdown) 15745 15794 51 1.0 1001.0 1.0X +Native ORC Vectorized 14642 14681 31 1.1 930.9 1.1X +Native ORC Vectorized (Pushdown) 14209 14239 19 1.1 903.4 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 14418 14430 13 1.1 916.7 1.0X -Parquet Vectorized (Pushdown) 14607 14620 20 1.1 928.7 1.0X -Native ORC Vectorized 13530 13543 10 1.2 860.2 1.1X -Native ORC Vectorized (Pushdown) 13632 13644 13 1.2 866.7 1.1X +Parquet Vectorized 17032 17078 45 0.9 1082.9 1.0X +Parquet Vectorized (Pushdown) 17495 17509 18 0.9 1112.3 1.0X +Native ORC Vectorized 15626 15720 61 1.0 993.5 1.1X +Native ORC Vectorized (Pushdown) 15871 15950 71 1.0 1009.1 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 14417 14423 13 1.1 916.6 1.0X -Parquet Vectorized (Pushdown) 14605 14613 12 1.1 928.6 1.0X -Native ORC Vectorized 13531 13550 15 1.2 860.3 1.1X -Native ORC Vectorized (Pushdown) 13637 13654 11 1.2 867.0 1.1X +Parquet Vectorized 17169 17200 20 0.9 1091.6 1.0X +Parquet Vectorized (Pushdown) 17450 17490 33 0.9 1109.4 1.0X +Native ORC Vectorized 16062 16134 81 1.0 1021.2 1.1X +Native ORC Vectorized (Pushdown) 16225 16281 48 1.0 1031.5 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 14439 14446 6 1.1 918.0 1.0X -Parquet Vectorized (Pushdown) 14630 14642 11 1.1 930.2 1.0X -Native ORC Vectorized 13210 13215 5 1.2 839.9 1.1X -Native ORC Vectorized (Pushdown) 13331 13338 6 1.2 847.6 1.1X +Parquet Vectorized 17091 17199 102 0.9 1086.6 1.0X +Parquet Vectorized (Pushdown) 17394 17480 60 0.9 1105.9 1.0X +Native ORC Vectorized 16322 16366 35 1.0 1037.7 1.0X +Native ORC Vectorized (Pushdown) 16459 16543 52 1.0 1046.4 1.0X ================================================================================================ Pushdown for few distinct value case (use dictionary encoding) ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7073 7083 16 2.2 449.7 1.0X -Parquet Vectorized (Pushdown) 401 403 3 39.2 25.5 17.6X -Native ORC Vectorized 7292 7305 20 2.2 463.6 1.0X -Native ORC Vectorized (Pushdown) 553 576 20 28.4 35.2 12.8X +Parquet Vectorized 8671 8722 42 1.8 551.3 1.0X +Parquet Vectorized (Pushdown) 567 576 9 27.7 36.1 15.3X +Native ORC Vectorized 8567 8600 48 1.8 544.7 1.0X +Native ORC Vectorized (Pushdown) 846 870 30 18.6 53.8 10.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7208 7218 9 2.2 458.3 1.0X -Parquet Vectorized (Pushdown) 400 402 3 39.3 25.4 18.0X -Native ORC Vectorized 7505 7510 3 2.1 477.1 1.0X -Native ORC Vectorized (Pushdown) 554 576 20 28.4 35.2 13.0X +Parquet Vectorized 8852 8890 30 1.8 562.8 1.0X +Parquet Vectorized (Pushdown) 563 567 5 27.9 35.8 15.7X +Native ORC Vectorized 8816 8847 25 1.8 560.5 1.0X +Native ORC Vectorized (Pushdown) 838 869 41 18.8 53.3 10.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7122 7128 5 2.2 452.8 1.0X -Parquet Vectorized (Pushdown) 456 461 6 34.5 29.0 15.6X -Native ORC Vectorized 7410 7421 9 2.1 471.1 1.0X -Native ORC Vectorized (Pushdown) 609 629 18 25.8 38.7 11.7X +Parquet Vectorized 8764 8799 24 1.8 557.2 1.0X +Parquet Vectorized (Pushdown) 632 637 6 24.9 40.2 13.9X +Native ORC Vectorized 8688 8707 24 1.8 552.4 1.0X +Native ORC Vectorized (Pushdown) 907 1073 259 17.3 57.7 9.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7130 7140 8 2.2 453.3 1.0X -Parquet Vectorized (Pushdown) 459 462 3 34.3 29.2 15.5X -Native ORC Vectorized 7439 7454 9 2.1 473.0 1.0X -Native ORC Vectorized (Pushdown) 613 634 18 25.6 39.0 11.6X +Parquet Vectorized 8789 8802 11 1.8 558.8 1.0X +Parquet Vectorized (Pushdown) 638 646 13 24.6 40.6 13.8X +Native ORC Vectorized 8707 8728 16 1.8 553.6 1.0X +Native ORC Vectorized (Pushdown) 909 931 26 17.3 57.8 9.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7208 7213 4 2.2 458.3 1.0X -Parquet Vectorized (Pushdown) 457 459 3 34.4 29.1 15.8X -Native ORC Vectorized 7550 7554 7 2.1 480.0 1.0X -Native ORC Vectorized (Pushdown) 610 631 18 25.8 38.8 11.8X +Parquet Vectorized 8888 8901 11 1.8 565.1 1.0X +Parquet Vectorized (Pushdown) 632 639 5 24.9 40.2 14.1X +Native ORC Vectorized 8835 9125 424 1.8 561.7 1.0X +Native ORC Vectorized (Pushdown) 909 951 53 17.3 57.8 9.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 15864 15885 15 1.0 1008.6 1.0X -Parquet Vectorized (Pushdown) 16029 16033 3 1.0 1019.1 1.0X -Native ORC Vectorized 16678 16689 8 0.9 1060.4 1.0X -Native ORC Vectorized (Pushdown) 16946 16963 10 0.9 1077.4 0.9X +Parquet Vectorized 18995 19038 52 0.8 1207.7 1.0X +Parquet Vectorized (Pushdown) 19265 19339 56 0.8 1224.9 1.0X +Native ORC Vectorized 19356 19526 130 0.8 1230.6 1.0X +Native ORC Vectorized (Pushdown) 19683 19762 105 0.8 1251.4 1.0X ================================================================================================ Pushdown benchmark for StringStartsWith ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8038 8048 16 2.0 511.0 1.0X -Parquet Vectorized (Pushdown) 1174 1179 4 13.4 74.6 6.8X -Native ORC Vectorized 6303 6320 27 2.5 400.7 1.3X -Native ORC Vectorized (Pushdown) 6429 6435 5 2.4 408.7 1.3X +Parquet Vectorized 9986 10034 42 1.6 634.9 1.0X +Parquet Vectorized (Pushdown) 1539 1553 20 10.2 97.8 6.5X +Native ORC Vectorized 7520 7560 30 2.1 478.1 1.3X +Native ORC Vectorized (Pushdown) 7717 7764 37 2.0 490.6 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7864 7868 3 2.0 500.0 1.0X -Parquet Vectorized (Pushdown) 462 464 2 34.0 29.4 17.0X -Native ORC Vectorized 6111 6113 2 2.6 388.5 1.3X -Native ORC Vectorized (Pushdown) 6239 6243 5 2.5 396.7 1.3X +Parquet Vectorized 9711 9754 31 1.6 617.4 1.0X +Parquet Vectorized (Pushdown) 647 657 12 24.3 41.1 15.0X +Native ORC Vectorized 7257 7309 42 2.2 461.4 1.3X +Native ORC Vectorized (Pushdown) 7424 7497 56 2.1 472.0 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7863 7868 4 2.0 499.9 1.0X -Parquet Vectorized (Pushdown) 457 460 3 34.4 29.1 17.2X -Native ORC Vectorized 6098 6108 13 2.6 387.7 1.3X -Native ORC Vectorized (Pushdown) 6224 6238 8 2.5 395.7 1.3X +Parquet Vectorized 9747 9835 94 1.6 619.7 1.0X +Parquet Vectorized (Pushdown) 648 656 8 24.3 41.2 15.0X +Native ORC Vectorized 7233 7262 50 2.2 459.8 1.3X +Native ORC Vectorized (Pushdown) 7463 7539 115 2.1 474.5 1.3X ================================================================================================ Pushdown benchmark for decimal ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3146 3157 18 5.0 200.0 1.0X -Parquet Vectorized (Pushdown) 113 115 3 139.2 7.2 27.8X -Native ORC Vectorized 4129 4140 12 3.8 262.5 0.8X -Native ORC Vectorized (Pushdown) 105 108 8 150.0 6.7 30.0X +Parquet Vectorized 4018 4049 32 3.9 255.4 1.0X +Parquet Vectorized (Pushdown) 163 178 19 96.6 10.4 24.7X +Native ORC Vectorized 4918 4969 39 3.2 312.7 0.8X +Native ORC Vectorized (Pushdown) 160 167 11 98.1 10.2 25.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4684 4691 9 3.4 297.8 1.0X -Parquet Vectorized (Pushdown) 2249 2252 2 7.0 143.0 2.1X -Native ORC Vectorized 5752 5758 4 2.7 365.7 0.8X -Native ORC Vectorized (Pushdown) 2517 2522 5 6.2 160.1 1.9X +Parquet Vectorized 5800 5837 36 2.7 368.8 1.0X +Parquet Vectorized (Pushdown) 2764 2787 19 5.7 175.7 2.1X +Native ORC Vectorized 7034 7050 13 2.2 447.2 0.8X +Native ORC Vectorized (Pushdown) 3179 3191 9 4.9 202.1 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9759 9776 19 1.6 620.5 1.0X -Parquet Vectorized (Pushdown) 9367 9380 8 1.7 595.6 1.0X -Native ORC Vectorized 11058 11075 14 1.4 703.0 0.9X -Native ORC Vectorized (Pushdown) 10554 10568 15 1.5 671.0 0.9X +Parquet Vectorized 12173 12215 33 1.3 773.9 1.0X +Parquet Vectorized (Pushdown) 11669 11723 31 1.3 741.9 1.0X +Native ORC Vectorized 13874 13893 19 1.1 882.1 0.9X +Native ORC Vectorized (Pushdown) 13241 13285 33 1.2 841.8 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10820 10837 14 1.5 687.9 1.0X -Parquet Vectorized (Pushdown) 10853 10885 63 1.4 690.0 1.0X -Native ORC Vectorized 12299 12309 14 1.3 782.0 0.9X -Native ORC Vectorized (Pushdown) 12339 12354 11 1.3 784.5 0.9X +Parquet Vectorized 13290 13316 23 1.2 845.0 1.0X +Parquet Vectorized (Pushdown) 13335 13367 23 1.2 847.8 1.0X +Native ORC Vectorized 15485 15504 18 1.0 984.5 0.9X +Native ORC Vectorized (Pushdown) 15576 15605 18 1.0 990.3 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3321 3334 15 4.7 211.2 1.0X -Parquet Vectorized (Pushdown) 114 117 6 138.4 7.2 29.2X -Native ORC Vectorized 4162 4169 9 3.8 264.6 0.8X -Native ORC Vectorized (Pushdown) 102 106 9 154.9 6.5 32.7X +Parquet Vectorized 4154 4175 32 3.8 264.1 1.0X +Parquet Vectorized (Pushdown) 159 162 7 98.9 10.1 26.1X +Native ORC Vectorized 4902 4926 25 3.2 311.7 0.8X +Native ORC Vectorized (Pushdown) 153 162 23 102.6 9.7 27.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4120 4127 7 3.8 261.9 1.0X -Parquet Vectorized (Pushdown) 1237 1238 2 12.7 78.6 3.3X -Native ORC Vectorized 4985 4993 5 3.2 316.9 0.8X -Native ORC Vectorized (Pushdown) 1347 1349 2 11.7 85.6 3.1X +Parquet Vectorized 5090 5114 46 3.1 323.6 1.0X +Parquet Vectorized (Pushdown) 1509 1533 45 10.4 95.9 3.4X +Native ORC Vectorized 5943 5952 11 2.6 377.9 0.9X +Native ORC Vectorized (Pushdown) 1649 1686 61 9.5 104.8 3.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7320 7325 5 2.1 465.4 1.0X -Parquet Vectorized (Pushdown) 5723 5724 2 2.7 363.8 1.3X -Native ORC Vectorized 8314 8320 5 1.9 528.6 0.9X -Native ORC Vectorized (Pushdown) 6314 6321 5 2.5 401.4 1.2X +Parquet Vectorized 8887 8938 79 1.8 565.0 1.0X +Parquet Vectorized (Pushdown) 6901 6917 13 2.3 438.8 1.3X +Native ORC Vectorized 10030 10047 15 1.6 637.7 0.9X +Native ORC Vectorized (Pushdown) 7672 7689 12 2.1 487.8 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10436 10442 5 1.5 663.5 1.0X -Parquet Vectorized (Pushdown) 10151 10157 7 1.5 645.4 1.0X -Native ORC Vectorized 11611 11616 5 1.4 738.2 0.9X -Native ORC Vectorized (Pushdown) 11230 11246 13 1.4 714.0 0.9X +Parquet Vectorized 12618 12633 19 1.2 802.2 1.0X +Parquet Vectorized (Pushdown) 12296 12315 13 1.3 781.7 1.0X +Native ORC Vectorized 14260 14318 43 1.1 906.6 0.9X +Native ORC Vectorized (Pushdown) 13661 13678 12 1.2 868.5 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 5211 5227 14 3.0 331.3 1.0X -Parquet Vectorized (Pushdown) 125 126 2 126.0 7.9 41.8X -Native ORC Vectorized 4174 4184 19 3.8 265.4 1.2X -Native ORC Vectorized (Pushdown) 101 104 8 155.2 6.4 51.4X +Parquet Vectorized 6470 6492 29 2.4 411.4 1.0X +Parquet Vectorized (Pushdown) 175 178 3 89.8 11.1 36.9X +Native ORC Vectorized 4928 4949 17 3.2 313.3 1.3X +Native ORC Vectorized (Pushdown) 153 166 23 103.0 9.7 42.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 6570 6578 13 2.4 417.7 1.0X -Parquet Vectorized (Pushdown) 1661 1666 3 9.5 105.6 4.0X -Native ORC Vectorized 5146 5149 3 3.1 327.2 1.3X -Native ORC Vectorized (Pushdown) 1485 1486 1 10.6 94.4 4.4X +Parquet Vectorized 7674 7709 60 2.0 487.9 1.0X +Parquet Vectorized (Pushdown) 1984 1994 10 7.9 126.1 3.9X +Native ORC Vectorized 6245 6259 15 2.5 397.1 1.2X +Native ORC Vectorized (Pushdown) 1926 1935 11 8.2 122.5 4.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10484 10510 14 1.5 666.6 1.0X -Parquet Vectorized (Pushdown) 7775 7783 10 2.0 494.3 1.3X -Native ORC Vectorized 9004 9013 10 1.7 572.4 1.2X -Native ORC Vectorized (Pushdown) 6983 6994 6 2.3 444.0 1.5X +Parquet Vectorized 12485 12497 10 1.3 793.7 1.0X +Parquet Vectorized (Pushdown) 9348 9376 26 1.7 594.3 1.3X +Native ORC Vectorized 11573 11583 12 1.4 735.8 1.1X +Native ORC Vectorized (Pushdown) 9211 9228 10 1.7 585.6 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 14365 14377 11 1.1 913.3 1.0X -Parquet Vectorized (Pushdown) 13837 13857 16 1.1 879.7 1.0X -Native ORC Vectorized 12809 12817 9 1.2 814.4 1.1X -Native ORC Vectorized (Pushdown) 12441 12455 14 1.3 791.0 1.2X +Parquet Vectorized 17198 17206 7 0.9 1093.4 1.0X +Parquet Vectorized (Pushdown) 16613 16629 12 0.9 1056.2 1.0X +Native ORC Vectorized 17081 17103 31 0.9 1086.0 1.0X +Native ORC Vectorized (Pushdown) 16659 16693 28 0.9 1059.2 1.0X ================================================================================================ Pushdown benchmark for InSet -> InFilters ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7298 7310 14 2.2 464.0 1.0X -Parquet Vectorized (Pushdown) 478 487 17 32.9 30.4 15.3X -Native ORC Vectorized 5522 5542 19 2.8 351.1 1.3X -Native ORC Vectorized (Pushdown) 309 319 17 50.9 19.6 23.6X +Parquet Vectorized 8986 9024 59 1.8 571.3 1.0X +Parquet Vectorized (Pushdown) 662 676 14 23.7 42.1 13.6X +Native ORC Vectorized 6568 6589 27 2.4 417.6 1.4X +Native ORC Vectorized (Pushdown) 462 475 18 34.0 29.4 19.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7299 7323 50 2.2 464.1 1.0X -Parquet Vectorized (Pushdown) 479 481 2 32.8 30.5 15.2X -Native ORC Vectorized 5509 5517 9 2.9 350.2 1.3X -Native ORC Vectorized (Pushdown) 307 317 17 51.2 19.5 23.7X +Parquet Vectorized 8973 8986 21 1.8 570.5 1.0X +Parquet Vectorized (Pushdown) 663 666 5 23.7 42.1 13.5X +Native ORC Vectorized 6569 6574 6 2.4 417.6 1.4X +Native ORC Vectorized (Pushdown) 462 507 57 34.0 29.4 19.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7306 7312 7 2.2 464.5 1.0X -Parquet Vectorized (Pushdown) 478 480 3 32.9 30.4 15.3X -Native ORC Vectorized 5513 5520 7 2.9 350.5 1.3X -Native ORC Vectorized (Pushdown) 308 319 17 51.0 19.6 23.7X +Parquet Vectorized 9003 9037 37 1.7 572.4 1.0X +Parquet Vectorized (Pushdown) 666 671 6 23.6 42.4 13.5X +Native ORC Vectorized 6571 6581 8 2.4 417.8 1.4X +Native ORC Vectorized (Pushdown) 463 473 18 34.0 29.4 19.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7312 7334 19 2.2 464.9 1.0X -Parquet Vectorized (Pushdown) 499 502 3 31.5 31.7 14.7X -Native ORC Vectorized 5528 5550 14 2.8 351.5 1.3X -Native ORC Vectorized (Pushdown) 326 339 19 48.2 20.8 22.4X +Parquet Vectorized 9015 9022 8 1.7 573.2 1.0X +Parquet Vectorized (Pushdown) 687 698 13 22.9 43.7 13.1X +Native ORC Vectorized 6592 6611 13 2.4 419.1 1.4X +Native ORC Vectorized (Pushdown) 485 497 16 32.5 30.8 18.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7312 7317 3 2.2 464.9 1.0X -Parquet Vectorized (Pushdown) 500 502 3 31.5 31.8 14.6X -Native ORC Vectorized 5531 5542 14 2.8 351.7 1.3X -Native ORC Vectorized (Pushdown) 326 338 18 48.3 20.7 22.4X +Parquet Vectorized 9001 9008 14 1.7 572.3 1.0X +Parquet Vectorized (Pushdown) 686 692 5 22.9 43.6 13.1X +Native ORC Vectorized 6599 6619 32 2.4 419.6 1.4X +Native ORC Vectorized (Pushdown) 473 483 17 33.2 30.1 19.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7325 7330 8 2.1 465.7 1.0X -Parquet Vectorized (Pushdown) 502 504 3 31.4 31.9 14.6X -Native ORC Vectorized 5495 5503 6 2.9 349.4 1.3X -Native ORC Vectorized (Pushdown) 326 339 19 48.2 20.7 22.4X +Parquet Vectorized 8996 9002 8 1.7 571.9 1.0X +Parquet Vectorized (Pushdown) 690 697 6 22.8 43.9 13.0X +Native ORC Vectorized 6579 6587 8 2.4 418.3 1.4X +Native ORC Vectorized (Pushdown) 481 490 15 32.7 30.6 18.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7586 7602 9 2.1 482.3 1.0X -Parquet Vectorized (Pushdown) 7757 7767 11 2.0 493.1 1.0X -Native ORC Vectorized 5799 5812 15 2.7 368.7 1.3X -Native ORC Vectorized (Pushdown) 462 473 15 34.1 29.3 16.4X +Parquet Vectorized 9292 9304 9 1.7 590.8 1.0X +Parquet Vectorized (Pushdown) 9558 9567 9 1.6 607.7 1.0X +Native ORC Vectorized 6898 6911 10 2.3 438.6 1.3X +Native ORC Vectorized (Pushdown) 625 641 15 25.2 39.8 14.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7585 7593 5 2.1 482.3 1.0X -Parquet Vectorized (Pushdown) 7775 7783 6 2.0 494.3 1.0X -Native ORC Vectorized 5800 5815 18 2.7 368.8 1.3X -Native ORC Vectorized (Pushdown) 475 486 14 33.1 30.2 16.0X +Parquet Vectorized 9281 9298 12 1.7 590.1 1.0X +Parquet Vectorized (Pushdown) 9546 9561 17 1.6 606.9 1.0X +Native ORC Vectorized 6877 6897 18 2.3 437.2 1.3X +Native ORC Vectorized (Pushdown) 661 668 15 23.8 42.0 14.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7588 7592 5 2.1 482.4 1.0X -Parquet Vectorized (Pushdown) 7773 7777 3 2.0 494.2 1.0X -Native ORC Vectorized 5795 5814 14 2.7 368.4 1.3X -Native ORC Vectorized (Pushdown) 475 487 15 33.1 30.2 16.0X +Parquet Vectorized 9322 9335 22 1.7 592.7 1.0X +Parquet Vectorized (Pushdown) 9551 9573 18 1.6 607.2 1.0X +Native ORC Vectorized 6902 6915 13 2.3 438.8 1.4X +Native ORC Vectorized (Pushdown) 659 680 25 23.9 41.9 14.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7551 7556 4 2.1 480.1 1.0X -Parquet Vectorized (Pushdown) 7718 7728 12 2.0 490.7 1.0X -Native ORC Vectorized 5757 5770 17 2.7 366.0 1.3X -Native ORC Vectorized (Pushdown) 580 590 13 27.1 36.9 13.0X +Parquet Vectorized 9278 9294 18 1.7 589.9 1.0X +Parquet Vectorized (Pushdown) 9520 9560 27 1.7 605.3 1.0X +Native ORC Vectorized 6855 6870 16 2.3 435.9 1.4X +Native ORC Vectorized (Pushdown) 795 808 16 19.8 50.5 11.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 100, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7531 7542 10 2.1 478.8 1.0X -Parquet Vectorized (Pushdown) 7704 7709 5 2.0 489.8 1.0X -Native ORC Vectorized 5746 5766 17 2.7 365.3 1.3X -Native ORC Vectorized (Pushdown) 647 656 12 24.3 41.1 11.6X +Parquet Vectorized 9306 9311 4 1.7 591.6 1.0X +Parquet Vectorized (Pushdown) 9529 9551 16 1.7 605.8 1.0X +Native ORC Vectorized 6875 6882 7 2.3 437.1 1.4X +Native ORC Vectorized (Pushdown) 853 865 15 18.4 54.2 10.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz InSet -> InFilters (values count: 100, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7531 7533 2 2.1 478.8 1.0X -Parquet Vectorized (Pushdown) 7723 7725 2 2.0 491.0 1.0X -Native ORC Vectorized 5766 5783 19 2.7 366.6 1.3X -Native ORC Vectorized (Pushdown) 647 656 12 24.3 41.1 11.6X +Parquet Vectorized 9256 9271 9 1.7 588.5 1.0X +Parquet Vectorized (Pushdown) 9500 9520 13 1.7 604.0 1.0X +Native ORC Vectorized 6843 6857 9 2.3 435.1 1.4X +Native ORC Vectorized (Pushdown) 858 870 14 18.3 54.6 10.8X ================================================================================================ Pushdown benchmark for tinyint ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 tinyint row (value = CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3477 3482 7 4.5 221.0 1.0X -Parquet Vectorized (Pushdown) 154 157 4 102.2 9.8 22.6X -Native ORC Vectorized 2480 2485 5 6.3 157.7 1.4X -Native ORC Vectorized (Pushdown) 145 148 9 108.8 9.2 24.1X +Parquet Vectorized 4303 4312 8 3.7 273.6 1.0X +Parquet Vectorized (Pushdown) 208 213 6 75.5 13.2 20.7X +Native ORC Vectorized 2950 2958 9 5.3 187.6 1.5X +Native ORC Vectorized (Pushdown) 207 212 10 76.1 13.1 20.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% tinyint rows (value < CAST(12 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4170 4173 6 3.8 265.1 1.0X -Parquet Vectorized (Pushdown) 1152 1155 3 13.7 73.2 3.6X -Native ORC Vectorized 3208 3215 6 4.9 204.0 1.3X -Native ORC Vectorized (Pushdown) 1074 1075 1 14.7 68.3 3.9X +Parquet Vectorized 5125 5162 57 3.1 325.9 1.0X +Parquet Vectorized (Pushdown) 1402 1419 16 11.2 89.2 3.7X +Native ORC Vectorized 3840 3849 8 4.1 244.1 1.3X +Native ORC Vectorized (Pushdown) 1302 1306 3 12.1 82.8 3.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% tinyint rows (value < CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7031 7038 5 2.2 447.0 1.0X -Parquet Vectorized (Pushdown) 5374 5378 2 2.9 341.7 1.3X -Native ORC Vectorized 6150 6158 6 2.6 391.0 1.1X -Native ORC Vectorized (Pushdown) 4983 4989 4 3.2 316.8 1.4X +Parquet Vectorized 8562 8577 12 1.8 544.4 1.0X +Parquet Vectorized (Pushdown) 6539 6564 22 2.4 415.8 1.3X +Native ORC Vectorized 7300 7320 13 2.2 464.1 1.2X +Native ORC Vectorized (Pushdown) 5944 5954 15 2.6 377.9 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% tinyint rows (value < CAST(114 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9911 9925 11 1.6 630.2 1.0X -Parquet Vectorized (Pushdown) 9619 9631 8 1.6 611.5 1.0X -Native ORC Vectorized 9075 9083 8 1.7 577.0 1.1X -Native ORC Vectorized (Pushdown) 8877 8881 3 1.8 564.4 1.1X +Parquet Vectorized 11989 12005 13 1.3 762.2 1.0X +Parquet Vectorized (Pushdown) 11637 11686 54 1.4 739.8 1.0X +Native ORC Vectorized 10795 10816 18 1.5 686.3 1.1X +Native ORC Vectorized (Pushdown) 10592 10599 5 1.5 673.4 1.1X ================================================================================================ Pushdown benchmark for Timestamp ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 timestamp stored as INT96 row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3792 3803 17 4.1 241.1 1.0X -Parquet Vectorized (Pushdown) 3831 3831 1 4.1 243.5 1.0X -Native ORC Vectorized 2315 2327 24 6.8 147.2 1.6X -Native ORC Vectorized (Pushdown) 84 88 9 186.8 5.4 45.0X +Parquet Vectorized 4700 4716 19 3.3 298.8 1.0X +Parquet Vectorized (Pushdown) 4745 4758 11 3.3 301.7 1.0X +Native ORC Vectorized 2848 2865 22 5.5 181.1 1.7X +Native ORC Vectorized (Pushdown) 129 135 12 122.2 8.2 36.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% timestamp stored as INT96 rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4575 4583 12 3.4 290.9 1.0X -Parquet Vectorized (Pushdown) 4602 4610 7 3.4 292.6 1.0X -Native ORC Vectorized 3103 3106 2 5.1 197.3 1.5X -Native ORC Vectorized (Pushdown) 1102 1103 1 14.3 70.1 4.2X +Parquet Vectorized 5575 5590 9 2.8 354.5 1.0X +Parquet Vectorized (Pushdown) 5610 5623 10 2.8 356.7 1.0X +Native ORC Vectorized 3706 3723 11 4.2 235.6 1.5X +Native ORC Vectorized (Pushdown) 1286 1287 2 12.2 81.7 4.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% timestamp stored as INT96 rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7577 7588 7 2.1 481.7 1.0X -Parquet Vectorized (Pushdown) 7609 7617 6 2.1 483.8 1.0X -Native ORC Vectorized 6137 6147 10 2.6 390.2 1.2X -Native ORC Vectorized (Pushdown) 5039 5044 5 3.1 320.4 1.5X +Parquet Vectorized 9872 9887 13 1.6 627.7 1.0X +Parquet Vectorized (Pushdown) 9932 9942 8 1.6 631.4 1.0X +Native ORC Vectorized 7238 7273 25 2.2 460.2 1.4X +Native ORC Vectorized (Pushdown) 5933 5937 6 2.7 377.2 1.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% timestamp stored as INT96 rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10506 10520 12 1.5 667.9 1.0X -Parquet Vectorized (Pushdown) 10545 10550 4 1.5 670.4 1.0X -Native ORC Vectorized 9179 9183 5 1.7 583.6 1.1X -Native ORC Vectorized (Pushdown) 8971 8988 14 1.8 570.3 1.2X +Parquet Vectorized 12660 12677 12 1.2 804.9 1.0X +Parquet Vectorized (Pushdown) 12652 12704 31 1.2 804.4 1.0X +Native ORC Vectorized 10842 10870 19 1.5 689.3 1.2X +Native ORC Vectorized (Pushdown) 10630 10639 6 1.5 675.9 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 timestamp stored as TIMESTAMP_MICROS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3243 3254 11 4.8 206.2 1.0X -Parquet Vectorized (Pushdown) 113 114 2 138.9 7.2 28.6X -Native ORC Vectorized 2317 2321 5 6.8 147.3 1.4X -Native ORC Vectorized (Pushdown) 84 86 8 188.3 5.3 38.8X +Parquet Vectorized 4057 4065 7 3.9 257.9 1.0X +Parquet Vectorized (Pushdown) 155 159 7 101.2 9.9 26.1X +Native ORC Vectorized 2828 2840 8 5.6 179.8 1.4X +Native ORC Vectorized (Pushdown) 126 130 9 124.8 8.0 32.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4021 4024 2 3.9 255.6 1.0X -Parquet Vectorized (Pushdown) 1207 1209 1 13.0 76.8 3.3X -Native ORC Vectorized 3104 3108 3 5.1 197.3 1.3X -Native ORC Vectorized (Pushdown) 1102 1104 2 14.3 70.1 3.6X +Parquet Vectorized 4926 4938 9 3.2 313.2 1.0X +Parquet Vectorized (Pushdown) 1415 1422 6 11.1 90.0 3.5X +Native ORC Vectorized 3705 3714 7 4.2 235.6 1.3X +Native ORC Vectorized (Pushdown) 1279 1285 9 12.3 81.3 3.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7038 7052 8 2.2 447.5 1.0X -Parquet Vectorized (Pushdown) 5487 5490 4 2.9 348.8 1.3X -Native ORC Vectorized 6135 6143 5 2.6 390.0 1.1X -Native ORC Vectorized (Pushdown) 5037 5044 6 3.1 320.3 1.4X +Parquet Vectorized 8409 8413 4 1.9 534.6 1.0X +Parquet Vectorized (Pushdown) 6489 6497 6 2.4 412.5 1.3X +Native ORC Vectorized 7248 7255 10 2.2 460.8 1.2X +Native ORC Vectorized (Pushdown) 5922 5932 7 2.7 376.5 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10004 10010 9 1.6 636.1 1.0X -Parquet Vectorized (Pushdown) 9715 9725 9 1.6 617.6 1.0X -Native ORC Vectorized 9166 9183 13 1.7 582.8 1.1X -Native ORC Vectorized (Pushdown) 8988 8995 7 1.7 571.4 1.1X +Parquet Vectorized 11821 11830 8 1.3 751.5 1.0X +Parquet Vectorized (Pushdown) 11478 11490 11 1.4 729.8 1.0X +Native ORC Vectorized 10851 10856 4 1.4 689.9 1.1X +Native ORC Vectorized (Pushdown) 10620 10628 10 1.5 675.2 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3460 3463 4 4.5 220.0 1.0X -Parquet Vectorized (Pushdown) 113 114 2 138.6 7.2 30.5X -Native ORC Vectorized 2312 2317 5 6.8 147.0 1.5X -Native ORC Vectorized (Pushdown) 84 87 8 187.6 5.3 41.3X +Parquet Vectorized 4307 4341 75 3.7 273.8 1.0X +Parquet Vectorized (Pushdown) 156 161 6 101.1 9.9 27.7X +Native ORC Vectorized 2825 2836 8 5.6 179.6 1.5X +Native ORC Vectorized (Pushdown) 125 128 9 125.4 8.0 34.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4236 4240 3 3.7 269.3 1.0X -Parquet Vectorized (Pushdown) 1229 1232 3 12.8 78.2 3.4X -Native ORC Vectorized 3109 3111 1 5.1 197.7 1.4X -Native ORC Vectorized (Pushdown) 1101 1102 1 14.3 70.0 3.8X +Parquet Vectorized 5173 5178 3 3.0 328.9 1.0X +Parquet Vectorized (Pushdown) 1444 1451 9 10.9 91.8 3.6X +Native ORC Vectorized 3707 3715 5 4.2 235.7 1.4X +Native ORC Vectorized (Pushdown) 1275 1276 2 12.3 81.0 4.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 7253 7258 4 2.2 461.2 1.0X -Parquet Vectorized (Pushdown) 5593 5597 5 2.8 355.6 1.3X -Native ORC Vectorized 6140 6150 6 2.6 390.4 1.2X -Native ORC Vectorized (Pushdown) 5036 5045 10 3.1 320.2 1.4X +Parquet Vectorized 8645 8655 9 1.8 549.6 1.0X +Parquet Vectorized (Pushdown) 6588 6603 11 2.4 418.9 1.3X +Native ORC Vectorized 7233 7246 13 2.2 459.9 1.2X +Native ORC Vectorized (Pushdown) 5904 5912 8 2.7 375.3 1.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 10220 10225 7 1.5 649.7 1.0X -Parquet Vectorized (Pushdown) 9907 9914 5 1.6 629.9 1.0X -Native ORC Vectorized 9186 9195 7 1.7 584.0 1.1X -Native ORC Vectorized (Pushdown) 8982 8991 9 1.8 571.1 1.1X +Parquet Vectorized 12057 12069 12 1.3 766.5 1.0X +Parquet Vectorized (Pushdown) 11694 11699 5 1.3 743.5 1.0X +Native ORC Vectorized 10817 10843 28 1.5 687.7 1.1X +Native ORC Vectorized (Pushdown) 10615 10634 11 1.5 674.9 1.1X ================================================================================================ Pushdown benchmark with many filters ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 row with 1 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 382 383 2 0.0 381955293.0 1.0X -Parquet Vectorized (Pushdown) 384 386 2 0.0 384491830.0 1.0X -Native ORC Vectorized 368 370 2 0.0 368178981.0 1.0X -Native ORC Vectorized (Pushdown) 368 369 3 0.0 368093099.0 1.0X +Parquet Vectorized 463 468 6 0.0 462711905.0 1.0X +Parquet Vectorized (Pushdown) 468 470 3 0.0 468018831.0 1.0X +Native ORC Vectorized 447 450 5 0.0 446698170.0 1.0X +Native ORC Vectorized (Pushdown) 449 458 11 0.0 448997785.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 row with 250 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 1250 1255 5 0.0 1249660759.0 1.0X -Parquet Vectorized (Pushdown) 1361 1368 7 0.0 1360758295.0 0.9X -Native ORC Vectorized 1232 1238 5 0.0 1232076103.0 1.0X -Native ORC Vectorized (Pushdown) 1239 1245 5 0.0 1239085148.0 1.0X +Parquet Vectorized 1538 1549 9 0.0 1538463215.0 1.0X +Parquet Vectorized (Pushdown) 1659 1668 6 0.0 1659315980.0 0.9X +Native ORC Vectorized 1513 1517 5 0.0 1512577059.0 1.0X +Native ORC Vectorized (Pushdown) 1517 1538 12 0.0 1516938695.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select 1 row with 500 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 3705 3730 22 0.0 3704960574.0 1.0X -Parquet Vectorized (Pushdown) 4120 4136 20 0.0 4120092427.0 0.9X -Native ORC Vectorized 3680 3696 16 0.0 3680418199.0 1.0X -Native ORC Vectorized (Pushdown) 3736 3742 6 0.0 3736469198.0 1.0X +Parquet Vectorized 4497 4525 29 0.0 4497410600.0 1.0X +Parquet Vectorized (Pushdown) 4945 4955 8 0.0 4945493883.0 0.9X +Native ORC Vectorized 4466 4485 23 0.0 4466103057.0 1.0X +Native ORC Vectorized (Pushdown) 4477 4496 18 0.0 4476752574.0 1.0X diff --git a/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt b/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt index 8d5e413e6f976..04474566ef43d 100644 --- a/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt @@ -2,739 +2,739 @@ In Expression Benchmark ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 73 91 10 136.2 7.3 1.0X -InSet expression 52 56 4 190.6 5.2 1.4X +In expression 163 213 53 61.4 16.3 1.0X +InSet expression 105 130 16 95.5 10.5 1.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 76 79 6 131.6 7.6 1.0X -InSet expression 59 61 2 169.4 5.9 1.3X +In expression 112 126 9 89.4 11.2 1.0X +InSet expression 78 92 11 128.4 7.8 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 109 111 2 91.9 10.9 1.0X -InSet expression 73 76 4 137.5 7.3 1.5X +In expression 170 181 8 58.9 17.0 1.0X +InSet expression 109 118 9 91.8 10.9 1.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 170 173 3 58.8 17.0 1.0X -InSet expression 97 99 1 103.0 9.7 1.8X +In expression 279 283 3 35.8 27.9 1.0X +InSet expression 140 148 8 71.6 14.0 2.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 296 298 2 33.8 29.6 1.0X -InSet expression 138 139 2 72.7 13.8 2.1X +In expression 461 486 28 21.7 46.1 1.0X +InSet expression 184 187 3 54.5 18.4 2.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 465 469 2 21.5 46.5 1.0X -InSet expression 240 242 3 41.7 24.0 1.9X +In expression 735 754 16 13.6 73.5 1.0X +InSet expression 317 323 5 31.6 31.7 2.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 46 47 3 218.5 4.6 1.0X -InSet expression 41 42 2 245.1 4.1 1.1X +In expression 63 68 5 157.8 6.3 1.0X +InSet expression 56 61 4 177.7 5.6 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 65 67 1 152.9 6.5 1.0X -InSet expression 41 42 1 246.6 4.1 1.6X +In expression 84 87 2 118.8 8.4 1.0X +InSet expression 58 62 4 171.6 5.8 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 93 95 3 107.5 9.3 1.0X -InSet expression 42 44 2 238.4 4.2 2.2X +In expression 139 146 10 72.0 13.9 1.0X +InSet expression 58 63 7 173.5 5.8 2.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 138 139 1 72.7 13.8 1.0X -InSet expression 47 49 2 210.5 4.7 2.9X +In expression 231 236 7 43.3 23.1 1.0X +InSet expression 59 64 8 170.5 5.9 3.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 250 251 1 40.0 25.0 1.0X -InSet expression 50 52 5 201.2 5.0 5.0X +In expression 411 414 3 24.3 41.1 1.0X +InSet expression 64 72 8 155.4 6.4 6.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 472 473 1 21.2 47.2 1.0X -InSet expression 53 54 1 189.1 5.3 8.9X +In expression 775 779 6 12.9 77.5 1.0X +InSet expression 70 74 4 142.7 7.0 11.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 780 782 1 12.8 78.0 1.0X -InSet expression 64 66 2 156.2 6.4 12.2X +In expression 1129 1133 3 8.9 112.9 1.0X +InSet expression 86 91 6 116.9 8.6 13.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1057 1058 1 9.5 105.7 1.0X -InSet expression 73 75 2 136.5 7.3 14.4X +In expression 1574 1577 3 6.4 157.4 1.0X +InSet expression 89 92 4 112.9 8.9 17.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1328 1330 1 7.5 132.8 1.0X -InSet expression 282 284 2 35.4 28.2 4.7X +In expression 1865 1914 100 5.4 186.5 1.0X +InSet expression 275 279 4 36.3 27.5 6.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 54 55 1 184.9 5.4 1.0X -InSet expression 55 56 2 182.6 5.5 1.0X +In expression 63 66 4 158.5 6.3 1.0X +InSet expression 62 68 14 160.7 6.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 71 72 1 141.4 7.1 1.0X -InSet expression 55 56 1 181.6 5.5 1.3X +In expression 81 87 10 124.0 8.1 1.0X +InSet expression 70 82 15 142.4 7.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 105 106 1 95.4 10.5 1.0X -InSet expression 73 74 1 137.2 7.3 1.4X +In expression 142 145 5 70.4 14.2 1.0X +InSet expression 78 80 3 128.4 7.8 1.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 173 174 1 58.0 17.3 1.0X -InSet expression 74 75 1 135.2 7.4 2.3X +In expression 229 235 14 43.8 22.9 1.0X +InSet expression 91 94 4 109.5 9.1 2.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 311 313 1 32.1 31.1 1.0X -InSet expression 97 98 1 103.3 9.7 3.2X +In expression 409 411 2 24.4 40.9 1.0X +InSet expression 108 112 5 92.9 10.8 3.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 543 544 1 18.4 54.3 1.0X -InSet expression 86 87 1 116.5 8.6 6.3X +In expression 772 779 8 12.9 77.2 1.0X +InSet expression 126 131 4 79.6 12.6 6.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 860 861 1 11.6 86.0 1.0X -InSet expression 101 102 1 99.2 10.1 8.5X +In expression 1138 1144 6 8.8 113.8 1.0X +InSet expression 136 140 6 73.5 13.6 8.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1132 1134 1 8.8 113.2 1.0X -InSet expression 125 126 1 80.1 12.5 9.1X +In expression 1500 1504 3 6.7 150.0 1.0X +InSet expression 148 154 6 67.7 14.8 10.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1405 1406 1 7.1 140.5 1.0X -InSet expression 286 288 2 35.0 28.6 4.9X +In expression 1932 1969 72 5.2 193.2 1.0X +InSet expression 275 278 3 36.3 27.5 7.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 47 48 1 212.1 4.7 1.0X -InSet expression 50 51 1 199.8 5.0 0.9X +In expression 57 59 2 174.1 5.7 1.0X +InSet expression 53 57 5 187.1 5.3 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 61 62 1 164.7 6.1 1.0X -InSet expression 38 39 1 263.3 3.8 1.6X +In expression 76 79 7 131.9 7.6 1.0X +InSet expression 54 57 8 186.1 5.4 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 91 92 1 109.6 9.1 1.0X -InSet expression 48 49 1 209.1 4.8 1.9X +In expression 128 132 3 77.9 12.8 1.0X +InSet expression 55 58 4 183.2 5.5 2.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 137 138 1 73.2 13.7 1.0X -InSet expression 41 42 2 242.5 4.1 3.3X +In expression 227 237 11 44.1 22.7 1.0X +InSet expression 56 58 2 178.0 5.6 4.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 236 236 1 42.4 23.6 1.0X -InSet expression 44 46 2 225.0 4.4 5.3X +In expression 407 413 9 24.5 40.7 1.0X +InSet expression 59 64 7 169.0 5.9 6.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 472 476 6 21.2 47.2 1.0X -InSet expression 53 54 2 190.3 5.3 9.0X +In expression 772 775 4 13.0 77.2 1.0X +InSet expression 67 70 5 148.7 6.7 11.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 796 797 1 12.6 79.6 1.0X -InSet expression 63 65 6 159.5 6.3 12.7X +In expression 1128 1132 3 8.9 112.8 1.0X +InSet expression 75 77 2 133.6 7.5 15.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1069 1070 1 9.4 106.9 1.0X -InSet expression 66 68 1 151.2 6.6 16.2X +In expression 1502 1507 6 6.7 150.2 1.0X +InSet expression 82 84 2 121.6 8.2 18.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1343 1344 1 7.4 134.3 1.0X -InSet expression 262 265 4 38.2 26.2 5.1X +In expression 1860 1897 75 5.4 186.0 1.0X +InSet expression 246 249 2 40.7 24.6 7.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 34 34 1 295.9 3.4 1.0X -InSet expression 37 38 2 272.1 3.7 0.9X +In expression 46 48 3 219.3 4.6 1.0X +InSet expression 40 41 2 251.6 4.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 47 48 1 211.1 4.7 1.0X -InSet expression 40 41 1 249.4 4.0 1.2X +In expression 65 67 2 154.5 6.5 1.0X +InSet expression 45 47 2 221.2 4.5 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 91 92 1 109.8 9.1 1.0X -InSet expression 38 38 1 264.3 3.8 2.4X +In expression 121 124 3 82.5 12.1 1.0X +InSet expression 46 49 4 217.2 4.6 2.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 159 159 1 62.9 15.9 1.0X -InSet expression 43 43 1 234.1 4.3 3.7X +In expression 214 216 2 46.7 21.4 1.0X +InSet expression 57 59 3 175.3 5.7 3.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 297 300 2 33.6 29.7 1.0X -InSet expression 49 50 2 203.2 4.9 6.0X +In expression 400 406 6 25.0 40.0 1.0X +InSet expression 58 61 3 173.9 5.8 7.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 578 579 1 17.3 57.8 1.0X -InSet expression 62 63 2 162.0 6.2 9.4X +In expression 762 765 2 13.1 76.2 1.0X +InSet expression 69 71 3 145.5 6.9 11.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 850 854 2 11.8 85.0 1.0X -InSet expression 76 77 1 131.5 7.6 11.2X +In expression 1116 1122 4 9.0 111.6 1.0X +InSet expression 84 87 2 118.5 8.4 13.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1126 1130 4 8.9 112.6 1.0X -InSet expression 80 81 1 125.2 8.0 14.1X +In expression 1491 1498 5 6.7 149.1 1.0X +InSet expression 88 91 2 113.4 8.8 16.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1412 1441 64 7.1 141.2 1.0X -InSet expression 268 269 1 37.3 26.8 5.3X +In expression 1858 1909 109 5.4 185.8 1.0X +InSet expression 247 249 2 40.5 24.7 7.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 42 42 1 240.2 4.2 1.0X -InSet expression 156 157 1 64.1 15.6 0.3X +In expression 53 54 2 190.2 5.3 1.0X +InSet expression 156 162 13 64.3 15.6 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 45 46 1 220.3 4.5 1.0X -InSet expression 176 177 1 56.9 17.6 0.3X +In expression 67 69 3 149.9 6.7 1.0X +InSet expression 171 174 2 58.5 17.1 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 76 77 1 131.1 7.6 1.0X -InSet expression 180 181 1 55.5 18.0 0.4X +In expression 120 122 4 83.0 12.0 1.0X +InSet expression 178 181 1 56.2 17.8 0.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 132 134 3 75.7 13.2 1.0X -InSet expression 231 233 4 43.3 23.1 0.6X +In expression 212 213 2 47.2 21.2 1.0X +InSet expression 222 224 3 45.0 22.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 237 237 1 42.3 23.7 1.0X -InSet expression 191 192 1 52.4 19.1 1.2X +In expression 393 398 4 25.5 39.3 1.0X +InSet expression 193 197 2 51.8 19.3 2.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 497 498 1 20.1 49.7 1.0X -InSet expression 177 179 1 56.4 17.7 2.8X +In expression 756 763 7 13.2 75.6 1.0X +InSet expression 186 188 2 53.8 18.6 4.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 57 57 1 175.8 5.7 1.0X -InSet expression 178 179 1 56.1 17.8 0.3X +In expression 92 94 4 109.1 9.2 1.0X +InSet expression 205 208 2 48.8 20.5 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 81 81 1 124.2 8.1 1.0X -InSet expression 207 208 1 48.3 20.7 0.4X +In expression 140 141 2 71.6 14.0 1.0X +InSet expression 232 235 2 43.0 23.2 0.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 159 159 1 63.1 15.9 1.0X -InSet expression 219 220 1 45.6 21.9 0.7X +In expression 247 250 5 40.5 24.7 1.0X +InSet expression 240 242 3 41.6 24.0 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 296 296 1 33.8 29.6 1.0X -InSet expression 277 278 1 36.1 27.7 1.1X +In expression 426 429 5 23.5 42.6 1.0X +InSet expression 290 293 4 34.5 29.0 1.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 564 565 1 17.7 56.4 1.0X -InSet expression 220 221 1 45.5 22.0 2.6X +In expression 785 787 2 12.7 78.5 1.0X +InSet expression 250 252 2 40.0 25.0 3.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2685 2743 125 3.7 268.5 1.0X -InSet expression 220 222 1 45.4 22.0 12.2X +In expression 3101 3190 192 3.2 310.1 1.0X +InSet expression 251 252 1 39.8 25.1 12.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 60 61 1 166.7 6.0 1.0X -InSet expression 163 163 1 61.5 16.3 0.4X +In expression 89 92 4 112.1 8.9 1.0X +InSet expression 171 175 2 58.4 17.1 0.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 80 80 1 124.9 8.0 1.0X -InSet expression 187 188 1 53.5 18.7 0.4X +In expression 135 136 2 73.9 13.5 1.0X +InSet expression 191 194 1 52.4 19.1 0.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 156 157 1 63.9 15.6 1.0X -InSet expression 187 188 1 53.6 18.7 0.8X +In expression 243 245 2 41.2 24.3 1.0X +InSet expression 199 201 1 50.4 19.9 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 294 295 2 34.0 29.4 1.0X -InSet expression 238 239 1 42.0 23.8 1.2X +In expression 420 423 2 23.8 42.0 1.0X +InSet expression 242 244 2 41.3 24.2 1.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 557 558 1 18.0 55.7 1.0X -InSet expression 198 200 1 50.5 19.8 2.8X +In expression 774 776 2 12.9 77.4 1.0X +InSet expression 210 216 5 47.7 21.0 3.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3152 3188 73 3.2 315.2 1.0X -InSet expression 188 189 1 53.2 18.8 16.8X +In expression 3627 3744 248 2.8 362.7 1.0X +InSet expression 202 206 2 49.4 20.2 17.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 38 39 1 26.0 38.4 1.0X -InSet expression 140 141 1 7.1 140.1 0.3X +In expression 52 55 4 19.2 52.1 1.0X +InSet expression 158 172 24 6.3 158.0 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 47 48 1 21.2 47.2 1.0X -InSet expression 143 143 0 7.0 143.1 0.3X +In expression 63 64 2 16.0 62.6 1.0X +InSet expression 160 164 4 6.2 160.1 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 78 78 1 12.9 77.5 1.0X -InSet expression 145 146 1 6.9 145.0 0.5X +In expression 97 99 2 10.3 97.2 1.0X +InSet expression 163 166 2 6.1 163.2 0.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 141 142 1 7.1 140.9 1.0X -InSet expression 153 154 1 6.5 153.3 0.9X +In expression 184 186 2 5.4 184.4 1.0X +InSet expression 173 176 2 5.8 173.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 344 347 2 2.9 344.1 1.0X -InSet expression 155 156 1 6.5 154.8 2.2X +In expression 472 478 9 2.1 472.4 1.0X +InSet expression 178 181 4 5.6 177.6 2.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 758 763 4 1.3 758.4 1.0X -InSet expression 165 166 1 6.1 165.1 4.6X +In expression 1054 1184 282 0.9 1053.8 1.0X +InSet expression 188 191 1 5.3 187.9 5.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 215 215 1 4.7 214.5 1.0X -InSet expression 169 170 1 5.9 169.2 1.3X +In expression 275 282 8 3.6 274.7 1.0X +InSet expression 195 199 8 5.1 194.7 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 363 365 1 2.8 363.3 1.0X -InSet expression 171 172 1 5.9 170.6 2.1X +In expression 458 470 8 2.2 458.4 1.0X +InSet expression 195 200 5 5.1 195.5 2.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 867 868 1 1.2 867.3 1.0X -InSet expression 177 179 1 5.6 177.1 4.9X +In expression 1093 1099 6 0.9 1093.3 1.0X +InSet expression 202 204 1 4.9 202.2 5.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1667 1674 14 0.6 1666.5 1.0X -InSet expression 182 183 1 5.5 181.8 9.2X +In expression 2091 2101 12 0.5 2090.6 1.0X +InSet expression 207 210 2 4.8 206.7 10.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3333 3363 54 0.3 3333.2 1.0X -InSet expression 199 200 1 5.0 198.7 16.8X +In expression 4164 4187 16 0.2 4164.1 1.0X +InSet expression 239 244 4 4.2 239.1 17.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 6637 6651 10 0.2 6637.5 1.0X -InSet expression 209 211 1 4.8 209.5 31.7X +In expression 8331 8353 21 0.1 8330.7 1.0X +InSet expression 251 252 1 4.0 250.7 33.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 55 56 1 18.2 54.9 1.0X -InSet expression 69 70 1 14.5 69.2 0.8X +In expression 66 67 2 15.2 65.8 1.0X +InSet expression 81 84 6 12.3 81.0 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 60 61 1 16.8 59.6 1.0X -InSet expression 72 73 1 13.9 71.8 0.8X +In expression 70 72 2 14.3 70.1 1.0X +InSet expression 84 86 2 12.0 83.6 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 80 81 1 12.5 80.1 1.0X -InSet expression 79 80 1 12.6 79.1 1.0X +In expression 89 92 3 11.2 89.3 1.0X +InSet expression 92 94 2 10.9 92.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 117 118 1 8.6 116.7 1.0X -InSet expression 82 83 1 12.3 81.5 1.4X +In expression 123 125 2 8.1 123.0 1.0X +InSet expression 95 97 2 10.6 94.7 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 217 219 1 4.6 217.4 1.0X -InSet expression 78 79 1 12.8 78.2 2.8X +In expression 221 223 2 4.5 220.7 1.0X +InSet expression 92 94 3 10.9 91.7 2.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 778 779 1 1.3 777.6 1.0X -InSet expression 83 84 1 12.0 83.1 9.4X +In expression 753 903 327 1.3 752.9 1.0X +InSet expression 97 100 3 10.3 97.2 7.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 31 32 1 320.8 3.1 1.0X -InSet expression 174 180 2 57.5 17.4 0.2X +In expression 48 49 2 209.3 4.8 1.0X +InSet expression 178 181 2 56.1 17.8 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 45 46 1 222.3 4.5 1.0X -InSet expression 199 200 1 50.3 19.9 0.2X +In expression 65 67 4 154.9 6.5 1.0X +InSet expression 196 198 1 50.9 19.6 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 91 92 1 109.4 9.1 1.0X -InSet expression 246 247 1 40.7 24.6 0.4X +In expression 118 121 6 84.5 11.8 1.0X +InSet expression 259 261 1 38.6 25.9 0.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 164 165 1 61.0 16.4 1.0X -InSet expression 262 263 1 38.2 26.2 0.6X +In expression 199 201 1 50.2 19.9 1.0X +InSet expression 280 282 3 35.7 28.0 0.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 298 307 6 33.6 29.8 1.0X -InSet expression 248 249 1 40.3 24.8 1.2X +In expression 368 370 2 27.1 36.8 1.0X +InSet expression 252 254 2 39.7 25.2 1.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 573 574 1 17.4 57.3 1.0X -InSet expression 241 242 1 41.4 24.1 2.4X +In expression 710 715 3 14.1 71.0 1.0X +InSet expression 251 255 6 39.8 25.1 2.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 501 503 1 19.9 50.1 1.0X -InSet expression 497 499 1 20.1 49.7 1.0X +In expression 699 701 2 14.3 69.9 1.0X +InSet expression 695 695 1 14.4 69.5 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 518 519 1 19.3 51.8 1.0X -InSet expression 502 504 1 19.9 50.2 1.0X +In expression 700 703 2 14.3 70.0 1.0X +InSet expression 700 701 1 14.3 70.0 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 554 555 2 18.1 55.4 1.0X -InSet expression 505 506 1 19.8 50.5 1.1X +In expression 742 746 3 13.5 74.2 1.0X +InSet expression 704 706 1 14.2 70.4 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 618 619 1 16.2 61.8 1.0X -InSet expression 507 508 1 19.7 50.7 1.2X +In expression 839 840 2 11.9 83.9 1.0X +InSet expression 710 713 2 14.1 71.0 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 756 760 3 13.2 75.6 1.0X -InSet expression 510 512 1 19.6 51.0 1.5X +In expression 1027 1030 2 9.7 102.7 1.0X +InSet expression 712 714 1 14.0 71.2 1.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1047 1050 3 9.6 104.7 1.0X -InSet expression 529 529 0 18.9 52.9 2.0X +In expression 1390 1411 43 7.2 139.0 1.0X +InSet expression 727 730 3 13.8 72.7 1.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1324 1331 4 7.6 132.4 1.0X -InSet expression 563 563 1 17.8 56.3 2.4X +In expression 1767 1774 8 5.7 176.7 1.0X +InSet expression 739 741 3 13.5 73.9 2.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1605 1612 6 6.2 160.5 1.0X -InSet expression 558 564 5 17.9 55.8 2.9X +In expression 2144 2155 12 4.7 214.4 1.0X +InSet expression 758 766 7 13.2 75.8 2.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1897 1906 5 5.3 189.7 1.0X -InSet expression 654 656 2 15.3 65.4 2.9X +In expression 2528 2552 22 4.0 252.8 1.0X +InSet expression 865 868 2 11.6 86.5 2.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 41 42 1 24.5 40.9 1.0X -InSet expression 93 95 3 10.8 92.5 0.4X +In expression 58 61 3 17.2 58.3 1.0X +InSet expression 113 115 2 8.9 112.7 0.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 63 64 1 15.8 63.3 1.0X -InSet expression 94 95 2 10.7 93.5 0.7X +In expression 86 89 3 11.7 85.8 1.0X +InSet expression 113 116 2 8.8 113.3 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 231 233 1 4.3 231.4 1.0X -InSet expression 120 120 0 8.4 119.5 1.9X +In expression 278 280 2 3.6 278.4 1.0X +InSet expression 141 145 5 7.1 140.6 2.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 483 484 2 2.1 482.9 1.0X -InSet expression 169 169 1 5.9 168.5 2.9X +In expression 577 704 75 1.7 576.9 1.0X +InSet expression 193 196 3 5.2 193.5 3.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 985 987 2 1.0 984.8 1.0X -InSet expression 202 206 7 5.0 201.6 4.9X +In expression 2462 2643 375 0.4 2461.6 1.0X +InSet expression 234 238 6 4.3 234.1 10.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2046 2177 248 0.5 2046.4 1.0X -InSet expression 269 270 1 3.7 269.0 7.6X +In expression 8526 9225 487 0.1 8526.5 1.0X +InSet expression 306 312 5 3.3 306.0 27.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 38 39 1 26.2 38.1 1.0X -InSet expression 136 138 1 7.3 136.4 0.3X +In expression 51 55 7 19.5 51.3 1.0X +InSet expression 169 172 2 5.9 168.8 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 48 49 3 21.0 47.6 1.0X -InSet expression 138 139 1 7.2 138.5 0.3X +In expression 62 66 6 16.2 61.6 1.0X +InSet expression 170 175 7 5.9 169.9 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 120 122 1 8.3 120.5 1.0X -InSet expression 177 178 1 5.7 176.5 0.7X +In expression 141 145 3 7.1 141.4 1.0X +InSet expression 213 220 8 4.7 212.7 0.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 284 285 1 3.5 283.8 1.0X -InSet expression 251 252 1 4.0 251.5 1.1X +In expression 335 365 67 3.0 334.9 1.0X +InSet expression 303 309 7 3.3 303.4 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 598 598 0 1.7 597.6 1.0X -InSet expression 299 300 1 3.3 298.8 2.0X +In expression 976 1114 286 1.0 976.4 1.0X +InSet expression 358 365 10 2.8 357.5 2.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1486 1623 209 0.7 1486.3 1.0X -InSet expression 415 415 1 2.4 414.6 3.6X +In expression 4162 4703 859 0.2 4162.5 1.0X +InSet expression 473 476 3 2.1 473.2 8.8X diff --git a/sql/core/benchmarks/InExpressionBenchmark-results.txt b/sql/core/benchmarks/InExpressionBenchmark-results.txt index 058ed31ad4db9..36d38ea9b162b 100644 --- a/sql/core/benchmarks/InExpressionBenchmark-results.txt +++ b/sql/core/benchmarks/InExpressionBenchmark-results.txt @@ -2,739 +2,739 @@ In Expression Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 67 76 6 148.9 6.7 1.0X -InSet expression 61 64 3 164.1 6.1 1.1X +In expression 132 172 32 75.7 13.2 1.0X +InSet expression 79 98 13 125.8 7.9 1.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 74 76 4 135.7 7.4 1.0X -InSet expression 59 61 2 168.1 5.9 1.2X +In expression 100 111 7 99.7 10.0 1.0X +InSet expression 70 78 9 143.0 7.0 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 107 109 2 93.2 10.7 1.0X -InSet expression 73 74 2 137.3 7.3 1.5X +In expression 161 170 7 62.0 16.1 1.0X +InSet expression 88 93 7 113.9 8.8 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 173 174 2 57.9 17.3 1.0X -InSet expression 90 92 2 110.9 9.0 1.9X +In expression 270 277 6 37.0 27.0 1.0X +InSet expression 116 123 9 86.0 11.6 2.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 296 298 2 33.8 29.6 1.0X -InSet expression 131 134 3 76.1 13.1 2.3X +In expression 450 463 13 22.2 45.0 1.0X +InSet expression 182 189 7 54.9 18.2 2.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 476 480 4 21.0 47.6 1.0X -InSet expression 220 228 6 45.6 22.0 2.2X +In expression 706 714 7 14.2 70.6 1.0X +InSet expression 302 311 7 33.1 30.2 2.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 46 47 3 219.2 4.6 1.0X -InSet expression 44 46 2 227.8 4.4 1.0X +In expression 62 64 5 162.2 6.2 1.0X +InSet expression 57 59 5 176.7 5.7 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 56 59 5 179.7 5.6 1.0X -InSet expression 38 39 2 261.4 3.8 1.5X +In expression 79 82 5 126.7 7.9 1.0X +InSet expression 53 54 3 188.7 5.3 1.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 83 83 1 121.1 8.3 1.0X -InSet expression 42 44 4 237.1 4.2 2.0X +In expression 132 135 5 75.8 13.2 1.0X +InSet expression 50 53 6 200.7 5.0 2.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 147 148 2 68.2 14.7 1.0X -InSet expression 44 44 1 228.1 4.4 3.3X +In expression 228 231 4 43.8 22.8 1.0X +InSet expression 51 53 3 195.5 5.1 4.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 239 239 0 41.8 23.9 1.0X -InSet expression 57 58 3 176.7 5.7 4.2X +In expression 404 404 0 24.8 40.4 1.0X +InSet expression 58 61 4 171.0 5.8 6.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 498 498 0 20.1 49.8 1.0X -InSet expression 63 63 1 159.6 6.3 8.0X +In expression 766 767 1 13.1 76.6 1.0X +InSet expression 66 68 3 151.0 6.6 11.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 770 770 0 13.0 77.0 1.0X -InSet expression 69 70 1 143.9 6.9 11.1X +In expression 1124 1124 0 8.9 112.4 1.0X +InSet expression 74 77 4 135.3 7.4 15.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1042 1043 1 9.6 104.2 1.0X -InSet expression 77 77 1 130.6 7.7 13.6X +In expression 1566 1567 2 6.4 156.6 1.0X +InSet expression 82 84 4 121.9 8.2 19.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1312 1313 1 7.6 131.2 1.0X -InSet expression 303 304 2 33.0 30.3 4.3X +In expression 1841 1871 37 5.4 184.1 1.0X +InSet expression 314 318 5 31.8 31.4 5.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 44 45 4 227.5 4.4 1.0X -InSet expression 41 41 1 243.5 4.1 1.1X +In expression 58 62 5 171.0 5.8 1.0X +InSet expression 53 55 4 187.5 5.3 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 54 55 1 184.4 5.4 1.0X -InSet expression 61 61 1 164.6 6.1 0.9X +In expression 76 77 2 131.3 7.6 1.0X +InSet expression 65 66 3 154.3 6.5 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 98 98 0 102.2 9.8 1.0X -InSet expression 64 64 1 156.9 6.4 1.5X +In expression 138 140 5 72.7 13.8 1.0X +InSet expression 74 78 8 135.2 7.4 1.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 175 177 1 57.0 17.5 1.0X -InSet expression 61 62 1 163.9 6.1 2.9X +In expression 226 227 1 44.2 22.6 1.0X +InSet expression 83 86 7 120.8 8.3 2.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 310 311 1 32.3 31.0 1.0X -InSet expression 69 70 2 144.8 6.9 4.5X +In expression 402 403 0 24.9 40.2 1.0X +InSet expression 93 94 3 108.0 9.3 4.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 585 586 0 17.1 58.5 1.0X -InSet expression 98 99 1 101.7 9.8 6.0X +In expression 761 762 0 13.1 76.1 1.0X +InSet expression 113 116 7 88.4 11.3 6.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 858 858 0 11.7 85.8 1.0X -InSet expression 98 99 1 101.6 9.8 8.7X +In expression 1125 1125 0 8.9 112.5 1.0X +InSet expression 136 142 11 73.5 13.6 8.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1133 1133 0 8.8 113.3 1.0X -InSet expression 101 102 1 98.7 10.1 11.2X +In expression 1486 1487 1 6.7 148.6 1.0X +InSet expression 141 142 2 70.8 14.1 10.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1404 1404 0 7.1 140.4 1.0X -InSet expression 304 307 9 32.9 30.4 4.6X +In expression 1842 1873 67 5.4 184.2 1.0X +InSet expression 315 318 3 31.7 31.5 5.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 47 48 1 213.3 4.7 1.0X -InSet expression 43 44 1 230.6 4.3 1.1X +In expression 54 55 4 186.6 5.4 1.0X +InSet expression 49 51 3 203.0 4.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 51 51 1 197.8 5.1 1.0X -InSet expression 34 34 1 296.2 3.4 1.5X +In expression 72 74 5 139.7 7.2 1.0X +InSet expression 46 48 5 218.2 4.6 1.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 88 88 0 114.1 8.8 1.0X -InSet expression 35 35 1 289.4 3.5 2.5X +In expression 125 127 5 79.9 12.5 1.0X +InSet expression 47 48 4 212.5 4.7 2.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 129 131 2 77.4 12.9 1.0X -InSet expression 43 43 1 234.0 4.3 3.0X +In expression 221 224 4 45.2 22.1 1.0X +InSet expression 48 49 3 206.3 4.8 4.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 225 225 0 44.5 22.5 1.0X -InSet expression 42 42 1 236.7 4.2 5.3X +In expression 401 404 6 25.0 40.1 1.0X +InSet expression 55 56 2 180.5 5.5 7.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 497 498 0 20.1 49.7 1.0X -InSet expression 48 49 1 206.7 4.8 10.3X +In expression 762 763 1 13.1 76.2 1.0X +InSet expression 63 69 14 159.8 6.3 12.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 775 775 0 12.9 77.5 1.0X -InSet expression 54 55 1 183.8 5.4 14.2X +In expression 1117 1117 0 9.0 111.7 1.0X +InSet expression 70 71 2 143.3 7.0 16.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1041 1041 0 9.6 104.1 1.0X -InSet expression 61 61 1 164.3 6.1 17.1X +In expression 1557 1558 1 6.4 155.7 1.0X +InSet expression 77 78 2 129.6 7.7 20.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1216 1216 0 8.2 121.6 1.0X -InSet expression 277 278 1 36.1 27.7 4.4X +In expression 1841 1877 79 5.4 184.1 1.0X +InSet expression 320 322 2 31.2 32.0 5.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 31 32 1 317.8 3.1 1.0X -InSet expression 29 29 1 348.3 2.9 1.1X +In expression 43 44 3 231.6 4.3 1.0X +InSet expression 40 42 4 252.4 4.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 46 46 1 219.4 4.6 1.0X -InSet expression 30 31 1 328.4 3.0 1.5X +In expression 62 64 4 162.0 6.2 1.0X +InSet expression 45 47 4 222.2 4.5 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 88 88 0 114.2 8.8 1.0X -InSet expression 44 45 1 225.5 4.4 2.0X +In expression 117 119 4 85.4 11.7 1.0X +InSet expression 57 59 5 176.9 5.7 2.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 155 155 0 64.5 15.5 1.0X -InSet expression 59 59 2 170.3 5.9 2.6X +In expression 207 207 0 48.3 20.7 1.0X +InSet expression 65 66 3 153.3 6.5 3.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 293 294 2 34.2 29.3 1.0X -InSet expression 62 62 2 161.7 6.2 4.7X +In expression 390 394 4 25.7 39.0 1.0X +InSet expression 76 77 3 132.0 7.6 5.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 575 575 0 17.4 57.5 1.0X -InSet expression 84 85 2 118.7 8.4 6.8X +In expression 752 755 2 13.3 75.2 1.0X +InSet expression 111 112 3 90.2 11.1 6.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 844 848 2 11.8 84.4 1.0X -InSet expression 94 95 2 106.5 9.4 9.0X +In expression 1106 1115 6 9.0 110.6 1.0X +InSet expression 129 130 3 77.7 12.9 8.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1116 1121 3 9.0 111.6 1.0X -InSet expression 104 104 2 96.5 10.4 10.8X +In expression 1476 1484 6 6.8 147.6 1.0X +InSet expression 129 130 3 77.3 12.9 11.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1398 1435 81 7.2 139.8 1.0X -InSet expression 278 279 2 36.0 27.8 5.0X +In expression 1844 1900 124 5.4 184.4 1.0X +InSet expression 321 322 2 31.2 32.1 5.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 34 35 1 292.1 3.4 1.0X -InSet expression 152 154 4 65.9 15.2 0.2X +In expression 50 53 5 199.5 5.0 1.0X +InSet expression 166 169 5 60.2 16.6 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 43 43 1 234.0 4.3 1.0X -InSet expression 172 173 4 58.3 17.2 0.2X +In expression 64 68 8 155.5 6.4 1.0X +InSet expression 186 188 4 53.9 18.6 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 73 73 0 136.5 7.3 1.0X -InSet expression 182 182 1 55.1 18.2 0.4X +In expression 118 119 2 84.7 11.8 1.0X +InSet expression 194 208 26 51.4 19.4 0.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 128 128 0 78.4 12.8 1.0X -InSet expression 227 229 2 44.0 22.7 0.6X +In expression 208 208 0 48.1 20.8 1.0X +InSet expression 240 244 5 41.7 24.0 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 233 234 1 42.9 23.3 1.0X -InSet expression 183 183 2 54.8 18.3 1.3X +In expression 390 397 10 25.6 39.0 1.0X +InSet expression 205 207 5 48.8 20.5 1.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 488 489 0 20.5 48.8 1.0X -InSet expression 180 181 1 55.6 18.0 2.7X +In expression 745 745 1 13.4 74.5 1.0X +InSet expression 194 197 5 51.5 19.4 3.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 57 57 0 175.1 5.7 1.0X -InSet expression 184 185 1 54.4 18.4 0.3X +In expression 90 91 1 111.2 9.0 1.0X +InSet expression 199 202 4 50.2 19.9 0.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 76 77 0 130.9 7.6 1.0X -InSet expression 208 208 1 48.1 20.8 0.4X +In expression 131 132 0 76.4 13.1 1.0X +InSet expression 221 223 2 45.2 22.1 0.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 155 156 0 64.4 15.5 1.0X -InSet expression 214 215 1 46.7 21.4 0.7X +In expression 244 245 0 40.9 24.4 1.0X +InSet expression 235 236 1 42.6 23.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 290 290 0 34.5 29.0 1.0X -InSet expression 271 271 1 37.0 27.1 1.1X +In expression 423 424 2 23.7 42.3 1.0X +InSet expression 284 285 2 35.3 28.4 1.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 555 556 0 18.0 55.5 1.0X -InSet expression 222 222 1 45.1 22.2 2.5X +In expression 777 778 1 12.9 77.7 1.0X +InSet expression 248 249 2 40.4 24.8 3.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2647 2702 118 3.8 264.7 1.0X -InSet expression 222 222 1 45.1 22.2 11.9X +In expression 3032 3125 203 3.3 303.2 1.0X +InSet expression 239 241 2 41.8 23.9 12.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 53 54 0 187.1 5.3 1.0X -InSet expression 140 141 2 71.6 14.0 0.4X +In expression 84 86 3 118.8 8.4 1.0X +InSet expression 167 168 2 59.9 16.7 0.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 75 76 1 132.8 7.5 1.0X -InSet expression 159 161 2 62.8 15.9 0.5X +In expression 126 127 1 79.1 12.6 1.0X +InSet expression 183 185 2 54.6 18.3 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 155 155 0 64.5 15.5 1.0X -InSet expression 165 166 1 60.5 16.5 0.9X +In expression 239 240 0 41.8 23.9 1.0X +InSet expression 189 192 4 52.9 18.9 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 288 288 0 34.7 28.8 1.0X -InSet expression 221 222 1 45.2 22.1 1.3X +In expression 417 417 0 24.0 41.7 1.0X +InSet expression 231 234 4 43.3 23.1 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 551 551 0 18.1 55.1 1.0X -InSet expression 175 175 1 57.2 17.5 3.2X +In expression 770 772 3 13.0 77.0 1.0X +InSet expression 201 204 5 49.7 20.1 3.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3185 3213 63 3.1 318.5 1.0X -InSet expression 177 177 1 56.6 17.7 18.0X +In expression 3587 3686 212 2.8 358.7 1.0X +InSet expression 196 198 3 50.9 19.6 18.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 37 38 1 26.9 37.2 1.0X -InSet expression 124 125 2 8.1 123.5 0.3X +In expression 50 51 2 20.1 49.7 1.0X +InSet expression 151 153 3 6.6 150.7 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 44 46 2 22.6 44.3 1.0X -InSet expression 126 127 2 8.0 125.5 0.4X +In expression 62 62 2 16.2 61.6 1.0X +InSet expression 153 155 2 6.5 153.3 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 72 72 1 13.9 71.8 1.0X -InSet expression 128 129 2 7.8 128.1 0.6X +In expression 95 96 2 10.5 95.0 1.0X +InSet expression 156 158 2 6.4 156.4 0.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 135 136 1 7.4 135.5 1.0X -InSet expression 136 137 2 7.4 135.8 1.0X +In expression 175 177 5 5.7 175.2 1.0X +InSet expression 165 167 3 6.1 164.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 319 320 0 3.1 318.8 1.0X -InSet expression 136 138 2 7.3 136.1 2.3X +In expression 440 440 0 2.3 439.7 1.0X +InSet expression 167 169 2 6.0 167.0 2.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 696 705 12 1.4 695.9 1.0X -InSet expression 146 147 2 6.9 145.7 4.8X +In expression 1005 1154 330 1.0 1004.8 1.0X +InSet expression 180 182 2 5.5 180.2 5.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 209 212 3 4.8 209.0 1.0X -InSet expression 152 155 4 6.6 152.3 1.4X +In expression 251 258 7 4.0 251.1 1.0X +InSet expression 193 197 3 5.2 193.2 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 355 356 1 2.8 355.0 1.0X -InSet expression 154 157 5 6.5 154.2 2.3X +In expression 424 437 8 2.4 424.2 1.0X +InSet expression 196 198 2 5.1 195.5 2.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 855 859 7 1.2 854.6 1.0X -InSet expression 161 163 1 6.2 161.3 5.3X +In expression 1018 1023 5 1.0 1017.8 1.0X +InSet expression 203 206 3 4.9 202.9 5.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1653 1656 2 0.6 1653.3 1.0X -InSet expression 165 169 8 6.0 165.4 10.0X +In expression 1947 1955 7 0.5 1947.5 1.0X +InSet expression 208 211 3 4.8 208.4 9.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3267 3278 9 0.3 3266.9 1.0X -InSet expression 185 187 2 5.4 185.1 17.7X +In expression 3886 3899 10 0.3 3885.9 1.0X +InSet expression 233 235 4 4.3 232.6 16.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 6556 6564 7 0.2 6556.0 1.0X -InSet expression 196 197 2 5.1 195.8 33.5X +In expression 7702 7793 60 0.1 7701.8 1.0X +InSet expression 243 248 6 4.1 243.4 31.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 102 103 1 9.8 102.5 1.0X -InSet expression 117 118 1 8.5 117.5 0.9X +In expression 132 135 4 7.6 132.1 1.0X +InSet expression 147 149 2 6.8 147.1 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 110 111 2 9.1 110.0 1.0X -InSet expression 121 122 1 8.3 120.7 0.9X +In expression 139 141 5 7.2 139.0 1.0X +InSet expression 150 151 2 6.7 149.6 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 130 131 1 7.7 129.9 1.0X -InSet expression 127 128 1 7.9 127.2 1.0X +In expression 160 161 2 6.3 159.6 1.0X +InSet expression 157 158 2 6.4 157.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 160 161 2 6.2 160.5 1.0X -InSet expression 129 131 2 7.7 129.4 1.2X +In expression 190 192 2 5.3 189.8 1.0X +InSet expression 160 161 2 6.2 160.5 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 230 231 1 4.3 230.4 1.0X -InSet expression 128 129 2 7.8 127.7 1.8X +In expression 264 265 2 3.8 263.8 1.0X +InSet expression 159 160 2 6.3 158.5 1.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 576 577 1 1.7 575.5 1.0X -InSet expression 131 132 1 7.6 131.3 4.4X +In expression 735 884 327 1.4 735.4 1.0X +InSet expression 164 166 3 6.1 163.9 4.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 30 30 2 338.4 3.0 1.0X -InSet expression 149 150 2 67.1 14.9 0.2X +In expression 45 46 3 223.6 4.5 1.0X +InSet expression 162 164 3 61.6 16.2 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 41 42 1 241.9 4.1 1.0X -InSet expression 165 165 1 60.7 16.5 0.3X +In expression 62 65 7 161.9 6.2 1.0X +InSet expression 179 181 2 56.0 17.9 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 81 82 4 123.4 8.1 1.0X -InSet expression 220 221 1 45.5 22.0 0.4X +In expression 115 116 1 86.8 11.5 1.0X +InSet expression 222 225 6 45.1 22.2 0.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 160 160 0 62.6 16.0 1.0X -InSet expression 238 239 1 42.1 23.8 0.7X +In expression 198 199 1 50.6 19.8 1.0X +InSet expression 238 239 2 42.0 23.8 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 296 297 1 33.8 29.6 1.0X -InSet expression 225 226 1 44.4 22.5 1.3X +In expression 363 368 5 27.6 36.3 1.0X +InSet expression 222 224 2 45.0 22.2 1.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 569 569 1 17.6 56.9 1.0X -InSet expression 226 230 7 44.2 22.6 2.5X +In expression 701 706 4 14.3 70.1 1.0X +InSet expression 226 228 3 44.2 22.6 3.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 550 551 0 18.2 55.0 1.0X -InSet expression 529 529 0 18.9 52.9 1.0X +In expression 659 665 5 15.2 65.9 1.0X +InSet expression 660 664 3 15.1 66.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 537 538 0 18.6 53.7 1.0X -InSet expression 531 531 0 18.8 53.1 1.0X +In expression 663 667 2 15.1 66.3 1.0X +InSet expression 659 661 2 15.2 65.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 583 583 0 17.2 58.3 1.0X -InSet expression 538 539 1 18.6 53.8 1.1X +In expression 700 705 4 14.3 70.0 1.0X +InSet expression 667 669 2 15.0 66.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 645 645 0 15.5 64.5 1.0X -InSet expression 546 546 0 18.3 54.6 1.2X +In expression 801 805 3 12.5 80.1 1.0X +InSet expression 675 677 1 14.8 67.5 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 771 772 0 13.0 77.1 1.0X -InSet expression 559 560 0 17.9 55.9 1.4X +In expression 984 987 5 10.2 98.4 1.0X +InSet expression 685 690 4 14.6 68.5 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1046 1055 18 9.6 104.6 1.0X -InSet expression 578 579 1 17.3 57.8 1.8X +In expression 1350 1356 4 7.4 135.0 1.0X +InSet expression 710 712 3 14.1 71.0 1.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 300 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1333 1335 2 7.5 133.3 1.0X -InSet expression 591 592 0 16.9 59.1 2.3X +In expression 1716 1722 6 5.8 171.6 1.0X +InSet expression 716 719 2 14.0 71.6 2.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 400 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1592 1599 6 6.3 159.2 1.0X -InSet expression 609 610 1 16.4 60.9 2.6X +In expression 2083 2100 13 4.8 208.3 1.0X +InSet expression 742 744 1 13.5 74.2 2.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 500 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1878 1883 4 5.3 187.8 1.0X -InSet expression 678 678 1 14.8 67.8 2.8X +In expression 2469 2486 11 4.1 246.9 1.0X +InSet expression 829 831 2 12.1 82.9 3.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 37 38 1 26.7 37.5 1.0X -InSet expression 108 109 1 9.2 108.1 0.3X +In expression 56 58 4 17.9 55.9 1.0X +InSet expression 123 124 2 8.1 123.1 0.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 60 60 1 16.8 59.7 1.0X -InSet expression 109 112 7 9.1 109.4 0.5X +In expression 83 84 2 12.1 82.7 1.0X +InSet expression 124 127 7 8.1 123.8 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 216 217 1 4.6 216.3 1.0X -InSet expression 140 141 1 7.1 140.0 1.5X +In expression 275 281 9 3.6 275.5 1.0X +InSet expression 155 158 4 6.4 155.2 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 476 477 1 2.1 475.9 1.0X -InSet expression 214 215 2 4.7 213.8 2.2X +In expression 659 718 109 1.5 659.4 1.0X +InSet expression 217 218 2 4.6 217.0 3.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1054 1055 2 0.9 1054.2 1.0X -InSet expression 237 239 3 4.2 237.1 4.4X +In expression 2488 2684 434 0.4 2488.4 1.0X +InSet expression 267 270 3 3.7 266.7 9.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2197 2374 391 0.5 2197.4 1.0X -InSet expression 323 325 2 3.1 323.5 6.8X +In expression 9462 10091 897 0.1 9462.2 1.0X +InSet expression 347 349 2 2.9 347.4 27.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 5 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 35 36 1 28.6 34.9 1.0X -InSet expression 122 124 3 8.2 122.1 0.3X +In expression 51 55 7 19.7 50.8 1.0X +InSet expression 166 168 4 6.0 166.3 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 10 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 50 51 2 20.0 50.0 1.0X -InSet expression 123 125 3 8.1 123.5 0.4X +In expression 66 70 5 15.1 66.4 1.0X +InSet expression 167 170 3 6.0 167.3 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 25 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 121 122 2 8.3 120.6 1.0X -InSet expression 158 159 1 6.3 158.1 0.8X +In expression 142 144 3 7.0 142.1 1.0X +InSet expression 211 215 6 4.7 211.2 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 50 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 303 307 9 3.3 303.3 1.0X -InSet expression 239 241 2 4.2 238.9 1.3X +In expression 375 378 5 2.7 375.5 1.0X +InSet expression 297 298 2 3.4 297.5 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 100 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 741 741 0 1.3 741.1 1.0X -InSet expression 270 273 3 3.7 270.0 2.7X +In expression 1122 1260 304 0.9 1122.2 1.0X +InSet expression 354 357 4 2.8 353.9 3.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz 200 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1632 1761 287 0.6 1632.3 1.0X -InSet expression 358 368 14 2.8 358.1 4.6X +In expression 5651 5989 644 0.2 5651.4 1.0X +InSet expression 471 473 2 2.1 471.0 12.0X diff --git a/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt b/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt index c544c1941a990..7d23e5467baed 100644 --- a/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt @@ -1,29 +1,29 @@ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast strings to intervals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare string w/ interval 589 613 25 1.7 589.2 1.0X -prepare string w/o interval 559 561 3 1.8 559.2 1.1X -1 units w/ interval 459 460 0 2.2 459.4 1.3X -1 units w/o interval 403 404 1 2.5 403.2 1.5X -2 units w/ interval 670 672 2 1.5 669.7 0.9X -2 units w/o interval 626 628 2 1.6 626.2 0.9X -3 units w/ interval 1478 1480 2 0.7 1478.4 0.4X -3 units w/o interval 1443 1445 1 0.7 1443.4 0.4X -4 units w/ interval 1893 1896 3 0.5 1893.3 0.3X -4 units w/o interval 1858 1859 1 0.5 1858.2 0.3X -5 units w/ interval 2090 2093 3 0.5 2090.1 0.3X -5 units w/o interval 2057 2059 3 0.5 2056.9 0.3X -6 units w/ interval 2307 2310 3 0.4 2306.6 0.3X -6 units w/o interval 2280 2280 0 0.4 2279.8 0.3X -7 units w/ interval 2598 2600 2 0.4 2598.5 0.2X -7 units w/o interval 2558 2560 2 0.4 2558.1 0.2X -8 units w/ interval 2993 2995 2 0.3 2992.9 0.2X -8 units w/o interval 2960 2963 4 0.3 2960.3 0.2X -9 units w/ interval 2910 2912 3 0.3 2909.7 0.2X -9 units w/o interval 2892 2893 2 0.3 2891.6 0.2X -10 units w/ interval 3247 3254 8 0.3 3247.0 0.2X -10 units w/o interval 3224 3229 8 0.3 3224.2 0.2X -11 units w/ interval 3984 3990 5 0.3 3984.2 0.1X -11 units w/o interval 3951 3953 1 0.3 3951.3 0.1X +prepare string w/ interval 756 831 78 1.3 756.4 1.0X +prepare string w/o interval 622 637 15 1.6 622.4 1.2X +1 units w/ interval 506 532 22 2.0 506.2 1.5X +1 units w/o interval 472 477 9 2.1 471.6 1.6X +2 units w/ interval 699 710 11 1.4 698.5 1.1X +2 units w/o interval 670 674 6 1.5 669.9 1.1X +3 units w/ interval 1431 1437 7 0.7 1431.3 0.5X +3 units w/o interval 1418 1429 11 0.7 1418.2 0.5X +4 units w/ interval 1687 1692 8 0.6 1686.8 0.4X +4 units w/o interval 1679 1688 7 0.6 1679.4 0.5X +5 units w/ interval 1862 1864 3 0.5 1861.9 0.4X +5 units w/o interval 1847 1864 15 0.5 1846.9 0.4X +6 units w/ interval 2067 2081 12 0.5 2066.9 0.4X +6 units w/o interval 2070 2071 2 0.5 2069.6 0.4X +7 units w/ interval 2458 2468 13 0.4 2457.7 0.3X +7 units w/o interval 2450 2453 3 0.4 2450.1 0.3X +8 units w/ interval 2833 2838 8 0.4 2832.6 0.3X +8 units w/o interval 2830 2839 8 0.4 2829.8 0.3X +9 units w/ interval 2873 2880 6 0.3 2873.4 0.3X +9 units w/o interval 2860 2863 3 0.3 2860.1 0.3X +10 units w/ interval 3252 3257 5 0.3 3252.2 0.2X +10 units w/o interval 3212 3220 8 0.3 3211.6 0.2X +11 units w/ interval 3369 3376 6 0.3 3368.5 0.2X +11 units w/o interval 3384 3395 15 0.3 3384.2 0.2X diff --git a/sql/core/benchmarks/IntervalBenchmark-results.txt b/sql/core/benchmarks/IntervalBenchmark-results.txt index d15d3ba36b8fb..da2f0e66dacac 100644 --- a/sql/core/benchmarks/IntervalBenchmark-results.txt +++ b/sql/core/benchmarks/IntervalBenchmark-results.txt @@ -1,29 +1,29 @@ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cast strings to intervals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare string w/ interval 448 479 28 2.2 447.9 1.0X -prepare string w/o interval 403 417 20 2.5 403.4 1.1X -1 units w/ interval 442 445 4 2.3 442.0 1.0X -1 units w/o interval 434 441 7 2.3 433.9 1.0X -2 units w/ interval 565 572 11 1.8 564.8 0.8X -2 units w/o interval 547 553 7 1.8 547.4 0.8X -3 units w/ interval 1250 1251 1 0.8 1249.7 0.4X -3 units w/o interval 1230 1233 3 0.8 1230.3 0.4X -4 units w/ interval 1434 1435 1 0.7 1434.5 0.3X -4 units w/o interval 1418 1421 4 0.7 1417.8 0.3X -5 units w/ interval 1581 1584 3 0.6 1580.8 0.3X -5 units w/o interval 1577 1581 3 0.6 1577.2 0.3X -6 units w/ interval 1761 1764 3 0.6 1760.6 0.3X -6 units w/o interval 1738 1743 7 0.6 1738.2 0.3X -7 units w/ interval 2180 2189 9 0.5 2179.6 0.2X -7 units w/o interval 2169 2171 2 0.5 2168.6 0.2X -8 units w/ interval 2415 2419 6 0.4 2414.8 0.2X -8 units w/o interval 2404 2407 3 0.4 2404.2 0.2X -9 units w/ interval 2332 2336 3 0.4 2332.4 0.2X -9 units w/o interval 2351 2353 2 0.4 2350.8 0.2X -10 units w/ interval 2870 2882 15 0.3 2869.7 0.2X -10 units w/o interval 2851 2852 1 0.4 2851.3 0.2X -11 units w/ interval 3108 3112 4 0.3 3107.6 0.1X -11 units w/o interval 3095 3097 2 0.3 3094.9 0.1X +prepare string w/ interval 648 721 94 1.5 648.3 1.0X +prepare string w/o interval 562 596 49 1.8 562.3 1.2X +1 units w/ interval 568 590 21 1.8 568.5 1.1X +1 units w/o interval 522 538 20 1.9 521.7 1.2X +2 units w/ interval 751 754 3 1.3 751.5 0.9X +2 units w/o interval 716 723 6 1.4 716.1 0.9X +3 units w/ interval 1402 1411 11 0.7 1401.6 0.5X +3 units w/o interval 1381 1387 5 0.7 1381.2 0.5X +4 units w/ interval 1591 1595 6 0.6 1591.2 0.4X +4 units w/o interval 1582 1585 3 0.6 1582.3 0.4X +5 units w/ interval 1747 1749 2 0.6 1747.3 0.4X +5 units w/o interval 1738 1746 10 0.6 1737.7 0.4X +6 units w/ interval 1929 1931 3 0.5 1929.1 0.3X +6 units w/o interval 1919 1922 2 0.5 1919.0 0.3X +7 units w/ interval 2345 2354 8 0.4 2345.0 0.3X +7 units w/o interval 2334 2336 2 0.4 2334.1 0.3X +8 units w/ interval 2533 2546 16 0.4 2533.0 0.3X +8 units w/o interval 2519 2521 1 0.4 2519.4 0.3X +9 units w/ interval 2885 2889 5 0.3 2884.5 0.2X +9 units w/o interval 2804 2813 12 0.4 2803.9 0.2X +10 units w/ interval 3041 3060 16 0.3 3041.3 0.2X +10 units w/o interval 3031 3043 15 0.3 3031.2 0.2X +11 units w/ interval 3270 3280 9 0.3 3269.9 0.2X +11 units w/o interval 3273 3280 7 0.3 3272.6 0.2X diff --git a/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt b/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt index 416ae3699770c..1e61017425aa3 100644 --- a/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt @@ -2,74 +2,74 @@ Join Benchmark ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long wholestage off 3567 3689 172 5.9 170.1 1.0X -Join w long wholestage on 1118 1134 11 18.8 53.3 3.2X +Join w long wholestage off 4441 4572 185 4.7 211.8 1.0X +Join w long wholestage on 1409 1500 96 14.9 67.2 3.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long duplicated wholestage off 4436 4443 9 4.7 211.5 1.0X -Join w long duplicated wholestage on 1178 1187 7 17.8 56.2 3.8X +Join w long duplicated wholestage off 5111 5116 7 4.1 243.7 1.0X +Join w long duplicated wholestage on 1493 1518 22 14.0 71.2 3.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 ints wholestage off 132395 132458 88 0.2 6313.1 1.0X -Join w 2 ints wholestage on 229504 229539 31 0.1 10943.6 0.6X +Join w 2 ints wholestage off 171821 171906 121 0.1 8193.0 1.0X +Join w 2 ints wholestage on 166559 166975 263 0.1 7942.1 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs wholestage off 5522 5555 47 3.8 263.3 1.0X -Join w 2 longs wholestage on 2734 2804 68 7.7 130.4 2.0X +Join w 2 longs wholestage off 7511 7555 62 2.8 358.2 1.0X +Join w 2 longs wholestage on 3776 4119 232 5.6 180.1 2.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs duplicated wholestage off 12116 12131 21 1.7 577.7 1.0X -Join w 2 longs duplicated wholestage on 6439 6474 28 3.3 307.0 1.9X +Join w 2 longs duplicated wholestage off 13563 13617 77 1.5 646.7 1.0X +Join w 2 longs duplicated wholestage on 7947 8053 71 2.6 378.9 1.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -outer join w long wholestage off 3142 3149 10 6.7 149.8 1.0X -outer join w long wholestage on 1135 1142 7 18.5 54.1 2.8X +outer join w long wholestage off 3915 3923 12 5.4 186.7 1.0X +outer join w long wholestage on 1421 1461 30 14.8 67.8 2.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -semi join w long wholestage off 1584 1589 7 13.2 75.6 1.0X -semi join w long wholestage on 651 655 5 32.2 31.0 2.4X +semi join w long wholestage off 2310 2332 30 9.1 110.2 1.0X +semi join w long wholestage on 835 860 34 25.1 39.8 2.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort merge join wholestage off 896 954 83 2.3 427.3 1.0X -sort merge join wholestage on 858 868 10 2.4 409.0 1.0X +sort merge join wholestage off 1846 1886 56 1.1 880.5 1.0X +sort merge join wholestage on 1402 1654 234 1.5 668.3 1.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort merge join with duplicates wholestage off 1527 1531 5 1.4 728.3 1.0X -sort merge join with duplicates wholestage on 1336 1354 26 1.6 636.9 1.1X +sort merge join with duplicates wholestage off 2852 2879 38 0.7 1360.0 1.0X +sort merge join with duplicates wholestage on 2645 2742 156 0.8 1261.0 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -shuffle hash join wholestage off 1113 1116 5 3.8 265.4 1.0X -shuffle hash join wholestage on 1080 1085 4 3.9 257.4 1.0X +shuffle hash join wholestage off 1506 1564 82 2.8 359.1 1.0X +shuffle hash join wholestage on 1303 1330 23 3.2 310.6 1.2X diff --git a/sql/core/benchmarks/JoinBenchmark-results.txt b/sql/core/benchmarks/JoinBenchmark-results.txt index a2d5a90738ae7..c19dd4f12bb32 100644 --- a/sql/core/benchmarks/JoinBenchmark-results.txt +++ b/sql/core/benchmarks/JoinBenchmark-results.txt @@ -2,74 +2,74 @@ Join Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long wholestage off 3457 3578 171 6.1 164.8 1.0X -Join w long wholestage on 870 959 108 24.1 41.5 4.0X +Join w long wholestage off 4531 4557 37 4.6 216.1 1.0X +Join w long wholestage on 1214 1310 95 17.3 57.9 3.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long duplicated wholestage off 4229 4234 7 5.0 201.6 1.0X -Join w long duplicated wholestage on 1270 1278 10 16.5 60.6 3.3X +Join w long duplicated wholestage off 5200 5239 55 4.0 248.0 1.0X +Join w long duplicated wholestage on 1535 1547 11 13.7 73.2 3.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 ints wholestage off 157379 157425 65 0.1 7504.4 1.0X -Join w 2 ints wholestage on 117583 117758 135 0.2 5606.8 1.3X +Join w 2 ints wholestage off 170776 170795 27 0.1 8143.2 1.0X +Join w 2 ints wholestage on 165134 165183 36 0.1 7874.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs wholestage off 5175 5212 52 4.1 246.8 1.0X -Join w 2 longs wholestage on 2464 2499 37 8.5 117.5 2.1X +Join w 2 longs wholestage off 6561 6595 48 3.2 312.8 1.0X +Join w 2 longs wholestage on 2999 3070 85 7.0 143.0 2.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs duplicated wholestage off 11505 11581 107 1.8 548.6 1.0X -Join w 2 longs duplicated wholestage on 6921 6986 51 3.0 330.0 1.7X +Join w 2 longs duplicated wholestage off 15731 15757 38 1.3 750.1 1.0X +Join w 2 longs duplicated wholestage on 8017 8112 80 2.6 382.3 2.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -outer join w long wholestage off 2895 2898 5 7.2 138.0 1.0X -outer join w long wholestage on 1006 1011 6 20.8 48.0 2.9X +outer join w long wholestage off 3573 3577 6 5.9 170.4 1.0X +outer join w long wholestage on 1310 1325 15 16.0 62.5 2.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -semi join w long wholestage off 1585 1587 3 13.2 75.6 1.0X -semi join w long wholestage on 607 618 9 34.5 29.0 2.6X +semi join w long wholestage off 1893 1916 33 11.1 90.3 1.0X +semi join w long wholestage on 819 842 30 25.6 39.0 2.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort merge join wholestage off 840 841 1 2.5 400.7 1.0X -sort merge join wholestage on 810 823 18 2.6 386.4 1.0X +sort merge join wholestage off 1302 1312 13 1.6 620.9 1.0X +sort merge join wholestage on 1168 1233 62 1.8 557.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort merge join with duplicates wholestage off 1407 1413 8 1.5 671.1 1.0X -sort merge join with duplicates wholestage on 1345 1362 22 1.6 641.4 1.0X +sort merge join with duplicates wholestage off 1996 2005 12 1.1 951.7 1.0X +sort merge join with duplicates wholestage on 1766 1803 42 1.2 842.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -shuffle hash join wholestage off 1066 1085 28 3.9 254.1 1.0X -shuffle hash join wholestage on 1022 1031 6 4.1 243.8 1.0X +shuffle hash join wholestage off 1298 1300 3 3.2 309.6 1.0X +shuffle hash join wholestage on 1201 1210 10 3.5 286.4 1.1X diff --git a/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt b/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt index 3769fda182395..920e0a7723e70 100644 --- a/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt @@ -3,110 +3,110 @@ Benchmark for performance of JSON parsing ================================================================================================ Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 57417 59374 953 1.7 574.2 1.0X -UTF-8 is set 90156 92689 NaN 1.1 901.6 0.6X +No encoding 84774 84927 264 1.2 847.7 1.0X +UTF-8 is set 119081 120155 1773 0.8 1190.8 0.7X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 36685 38315 1414 2.7 366.9 1.0X -UTF-8 is set 62956 64488 1328 1.6 629.6 0.6X +No encoding 49293 49356 70 2.0 492.9 1.0X +UTF-8 is set 80183 80211 25 1.2 801.8 0.6X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 53021 56113 NaN 0.2 5302.1 1.0X -UTF-8 is set 84490 88618 1904 0.1 8449.0 0.6X +No encoding 61070 61476 536 0.2 6107.0 1.0X +UTF-8 is set 109765 109881 102 0.1 10976.5 0.6X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 129822 131107 NaN 0.0 259643.1 1.0X -UTF-8 is set 147795 154502 NaN 0.0 295589.1 0.9X +No encoding 176999 178163 1008 0.0 353997.9 1.0X +UTF-8 is set 201209 201641 614 0.0 402419.0 0.9X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns 15051 15603 478 0.7 1505.1 1.0X -Select 1 column 18987 19021 31 0.5 1898.7 0.8X +Select 10 columns 18768 20587 496 0.5 1876.8 1.0X +Select 1 column 22642 22644 3 0.4 2264.2 0.8X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Short column without encoding 6182 6251 61 1.6 618.2 1.0X -Short column with UTF-8 8913 8930 27 1.1 891.3 0.7X -Wide column without encoding 84504 87084 NaN 0.1 8450.4 0.1X -Wide column with UTF-8 129669 131259 1920 0.1 12966.9 0.0X +Short column without encoding 7697 7738 55 1.3 769.7 1.0X +Short column with UTF-8 14051 14189 176 0.7 1405.1 0.5X +Wide column without encoding 108999 110075 1085 0.1 10899.9 0.1X +Wide column with UTF-8 157433 157779 308 0.1 15743.3 0.0X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 602 606 6 16.6 60.2 1.0X -from_json 18369 18424 55 0.5 1836.9 0.0X -json_tuple 22175 22262 144 0.5 2217.5 0.0X -get_json_object 18619 18658 44 0.5 1861.9 0.0X +Text read 644 647 4 15.5 64.4 1.0X +from_json 25859 25872 12 0.4 2585.9 0.0X +json_tuple 31679 31761 71 0.3 3167.9 0.0X +get_json_object 24772 25220 389 0.4 2477.2 0.0X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 2983 2987 4 16.8 59.7 1.0X -schema inferring 25172 25190 18 2.0 503.4 0.1X -parsing 25643 26105 402 1.9 512.9 0.1X +Text read 3135 3165 52 15.9 62.7 1.0X +schema inferring 29383 29389 10 1.7 587.7 0.1X +parsing 32623 35183 NaN 1.5 652.5 0.1X Preparing data for benchmarking ... -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 10764 10787 28 4.6 215.3 1.0X -Schema inferring 36000 36032 35 1.4 720.0 0.3X -Parsing without charset 29164 29277 99 1.7 583.3 0.4X -Parsing with UTF-8 42282 42357 90 1.2 845.6 0.3X +Text read 11874 11948 82 4.2 237.5 1.0X +Schema inferring 42382 42398 23 1.2 847.6 0.3X +Parsing without charset 36410 36442 54 1.4 728.2 0.3X +Parsing with UTF-8 62412 62463 48 0.8 1248.2 0.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 1256 1259 3 8.0 125.6 1.0X -to_json(timestamp) 11850 12043 244 0.8 1185.0 0.1X -write timestamps to files 9968 10034 58 1.0 996.8 0.1X -Create a dataset of dates 1313 1333 27 7.6 131.3 1.0X -to_json(date) 8130 8196 57 1.2 813.0 0.2X -write dates to files 5761 5814 53 1.7 576.1 0.2X +Create a dataset of timestamps 2191 2209 20 4.6 219.1 1.0X +to_json(timestamp) 18670 19042 565 0.5 1867.0 0.1X +write timestamps to files 11836 13156 NaN 0.8 1183.6 0.2X +Create a dataset of dates 2321 2351 33 4.3 232.1 0.9X +to_json(date) 12703 12726 24 0.8 1270.3 0.2X +write dates to files 8230 8303 76 1.2 823.0 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 2480 2493 15 4.0 248.0 1.0X -read timestamps from files 21338 21364 27 0.5 2133.8 0.1X -infer timestamps from files 44079 44204 159 0.2 4407.9 0.1X -read date text from files 2297 2318 22 4.4 229.7 1.1X -read date from files 15020 15091 81 0.7 1502.0 0.2X -timestamp strings 2185 2191 10 4.6 218.5 1.1X -parse timestamps from Dataset[String] 22879 22963 73 0.4 2287.9 0.1X -infer timestamps from Dataset[String] 45896 46150 233 0.2 4589.6 0.1X -date strings 3171 3179 14 3.2 317.1 0.8X -parse dates from Dataset[String] 18291 18409 105 0.5 1829.1 0.1X -from_json(timestamp) 36083 36096 17 0.3 3608.3 0.1X -from_json(date) 31175 31188 11 0.3 3117.5 0.1X +read timestamp text from files 2780 2795 13 3.6 278.0 1.0X +read timestamps from files 37158 37305 137 0.3 3715.8 0.1X +infer timestamps from files 73666 73838 149 0.1 7366.6 0.0X +read date text from files 2597 2609 10 3.9 259.7 1.1X +read date from files 24439 24501 56 0.4 2443.9 0.1X +timestamp strings 3052 3064 12 3.3 305.2 0.9X +parse timestamps from Dataset[String] 43611 43665 52 0.2 4361.1 0.1X +infer timestamps from Dataset[String] 83745 84153 376 0.1 8374.5 0.0X +date strings 4068 4076 10 2.5 406.8 0.7X +parse dates from Dataset[String] 34700 34807 118 0.3 3470.0 0.1X +from_json(timestamp) 64074 64124 53 0.2 6407.4 0.0X +from_json(date) 52520 52617 101 0.2 5252.0 0.1X diff --git a/sql/core/benchmarks/JsonBenchmark-results.txt b/sql/core/benchmarks/JsonBenchmark-results.txt index 5b4dd9cdacf0a..e435f573a5d92 100644 --- a/sql/core/benchmarks/JsonBenchmark-results.txt +++ b/sql/core/benchmarks/JsonBenchmark-results.txt @@ -3,110 +3,110 @@ Benchmark for performance of JSON parsing ================================================================================================ Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 52901 52972 61 1.9 529.0 1.0X -UTF-8 is set 77163 77376 223 1.3 771.6 0.7X +No encoding 61888 61918 27 1.6 618.9 1.0X +UTF-8 is set 109057 113663 NaN 0.9 1090.6 0.6X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 35018 35108 109 2.9 350.2 1.0X -UTF-8 is set 63330 63390 103 1.6 633.3 0.6X +No encoding 44517 44535 29 2.2 445.2 1.0X +UTF-8 is set 75722 75840 111 1.3 757.2 0.6X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 66069 66269 299 0.2 6606.9 1.0X -UTF-8 is set 79950 80113 146 0.1 7995.0 0.8X +No encoding 63677 64090 633 0.2 6367.7 1.0X +UTF-8 is set 99424 99615 185 0.1 9942.4 0.6X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 122675 122866 186 0.0 245349.2 1.0X -UTF-8 is set 136683 137031 399 0.0 273365.5 0.9X +No encoding 174052 174251 174 0.0 348104.1 1.0X +UTF-8 is set 189000 189098 113 0.0 378000.9 0.9X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns 14113 14139 23 0.7 1411.3 1.0X -Select 1 column 16870 16897 44 0.6 1687.0 0.8X +Select 10 columns 18387 18473 142 0.5 1838.7 1.0X +Select 1 column 25560 25571 13 0.4 2556.0 0.7X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Short column without encoding 5563 5583 18 1.8 556.3 1.0X -Short column with UTF-8 8394 8422 34 1.2 839.4 0.7X -Wide column without encoding 97876 98392 497 0.1 9787.6 0.1X -Wide column with UTF-8 147797 147964 189 0.1 14779.7 0.0X +Short column without encoding 9323 9384 58 1.1 932.3 1.0X +Short column with UTF-8 14016 14058 55 0.7 1401.6 0.7X +Wide column without encoding 133258 133532 382 0.1 13325.8 0.1X +Wide column with UTF-8 181212 181283 61 0.1 18121.2 0.1X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 946 948 2 10.6 94.6 1.0X -from_json 17722 17821 86 0.6 1772.2 0.1X -json_tuple 21159 21179 17 0.5 2115.9 0.0X -get_json_object 17903 17925 23 0.6 1790.3 0.1X +Text read 1168 1174 5 8.6 116.8 1.0X +from_json 22604 23571 883 0.4 2260.4 0.1X +json_tuple 29979 30053 91 0.3 2997.9 0.0X +get_json_object 21987 22263 241 0.5 2198.7 0.1X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 4640 4649 8 10.8 92.8 1.0X -schema inferring 25039 25119 103 2.0 500.8 0.2X -parsing 22052 22864 1101 2.3 441.0 0.2X +Text read 5831 5842 14 8.6 116.6 1.0X +schema inferring 31372 31456 73 1.6 627.4 0.2X +parsing 35911 36191 254 1.4 718.2 0.2X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 8182 8209 34 6.1 163.6 1.0X -Schema inferring 29153 29210 73 1.7 583.1 0.3X -Parsing without charset 25596 25613 24 2.0 511.9 0.3X -Parsing with UTF-8 37515 37570 76 1.3 750.3 0.2X +Text read 10249 10314 77 4.9 205.0 1.0X +Schema inferring 35403 35436 40 1.4 708.1 0.3X +Parsing without charset 32875 32879 4 1.5 657.5 0.3X +Parsing with UTF-8 53444 53519 100 0.9 1068.9 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 1094 1097 3 9.1 109.4 1.0X -to_json(timestamp) 10869 10974 101 0.9 1086.9 0.1X -write timestamps to files 9136 9143 6 1.1 913.6 0.1X -Create a dataset of dates 1243 1255 16 8.0 124.3 0.9X -to_json(date) 6853 6864 10 1.5 685.3 0.2X -write dates to files 5153 5179 27 1.9 515.3 0.2X +Create a dataset of timestamps 1909 1924 17 5.2 190.9 1.0X +to_json(timestamp) 18956 19122 208 0.5 1895.6 0.1X +write timestamps to files 13446 13472 43 0.7 1344.6 0.1X +Create a dataset of dates 2180 2200 28 4.6 218.0 0.9X +to_json(date) 12780 12899 109 0.8 1278.0 0.1X +write dates to files 7835 7865 29 1.3 783.5 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 1901 1922 18 5.3 190.1 1.0X -read timestamps from files 18489 18554 58 0.5 1848.9 0.1X -infer timestamps from files 38533 38612 70 0.3 3853.3 0.0X -read date text from files 1756 1761 4 5.7 175.6 1.1X -read date from files 13712 13725 14 0.7 1371.2 0.1X -timestamp strings 2627 2633 7 3.8 262.7 0.7X -parse timestamps from Dataset[String] 20813 20882 95 0.5 2081.3 0.1X -infer timestamps from Dataset[String] 41976 42187 222 0.2 4197.6 0.0X -date strings 3062 3068 9 3.3 306.2 0.6X -parse dates from Dataset[String] 16354 16386 49 0.6 1635.4 0.1X -from_json(timestamp) 34532 34611 93 0.3 3453.2 0.1X -from_json(date) 29854 29943 134 0.3 2985.4 0.1X +read timestamp text from files 2467 2477 9 4.1 246.7 1.0X +read timestamps from files 40186 40342 135 0.2 4018.6 0.1X +infer timestamps from files 82005 82079 71 0.1 8200.5 0.0X +read date text from files 2243 2264 22 4.5 224.3 1.1X +read date from files 24852 24863 19 0.4 2485.2 0.1X +timestamp strings 3836 3854 16 2.6 383.6 0.6X +parse timestamps from Dataset[String] 51521 51697 242 0.2 5152.1 0.0X +infer timestamps from Dataset[String] 97300 97398 133 0.1 9730.0 0.0X +date strings 4488 4491 5 2.2 448.8 0.5X +parse dates from Dataset[String] 37918 37976 68 0.3 3791.8 0.1X +from_json(timestamp) 69611 69632 36 0.1 6961.1 0.0X +from_json(date) 56598 56974 347 0.2 5659.8 0.0X diff --git a/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt b/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt index 0b943e682b4d6..65faa752b94cb 100644 --- a/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt @@ -1,22 +1,22 @@ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_date() 2439 2458 17 41.0 24.4 1.0X -make_date(2019, 9, 16) 1898 1913 22 52.7 19.0 1.3X -make_date(*, *, *) 3592 3603 15 27.8 35.9 0.7X +prepare make_date() 3204 3323 139 31.2 32.0 1.0X +make_date(2019, 9, 16) 2529 2604 126 39.5 25.3 1.3X +make_date(*, *, *) 5102 5113 10 19.6 51.0 0.6X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_timestamp() 3031 3044 12 0.3 3031.2 1.0X -make_timestamp(2019, 1, 2, 3, 4, 50.123456) 47 48 1 21.5 46.5 65.2X -make_timestamp(2019, 1, 2, 3, 4, 60.000000) 46 46 0 22.0 45.5 66.6X -make_timestamp(2019, 12, 31, 23, 59, 60.00) 42 43 1 23.8 42.1 72.0X -make_timestamp(*, *, *, 3, 4, 50.123456) 220 220 0 4.5 220.2 13.8X -make_timestamp(*, *, *, *, *, 0) 214 218 4 4.7 214.3 14.1X -make_timestamp(*, *, *, *, *, 60.0) 216 217 1 4.6 216.1 14.0X -make_timestamp(2019, 1, 2, *, *, *) 3187 3187 1 0.3 3186.5 1.0X -make_timestamp(*, *, *, *, *, *) 3194 3198 4 0.3 3194.1 0.9X +prepare make_timestamp() 3484 3513 28 0.3 3484.3 1.0X +make_timestamp(2019, 1, 2, 3, 4, 50.123456) 112 131 17 9.0 111.5 31.2X +make_timestamp(2019, 1, 2, 3, 4, 60.000000) 93 102 10 10.8 92.8 37.6X +make_timestamp(2019, 12, 31, 23, 59, 60.00) 85 88 4 11.8 84.8 41.1X +make_timestamp(*, *, *, 3, 4, 50.123456) 303 308 8 3.3 302.8 11.5X +make_timestamp(*, *, *, *, *, 0) 303 307 3 3.3 302.8 11.5X +make_timestamp(*, *, *, *, *, 60.0) 289 297 8 3.5 289.1 12.1X +make_timestamp(2019, 1, 2, *, *, *) 3576 3585 11 0.3 3576.4 1.0X +make_timestamp(*, *, *, *, *, *) 3610 3618 12 0.3 3610.0 1.0X diff --git a/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt b/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt index 8c9f232e96495..92bcc4444e60a 100644 --- a/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt +++ b/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt @@ -1,22 +1,22 @@ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_date() 2170 2334 278 46.1 21.7 1.0X -make_date(2019, 9, 16) 1771 1774 4 56.5 17.7 1.2X -make_date(*, *, *) 3587 3608 32 27.9 35.9 0.6X +prepare make_date() 2920 3239 278 34.3 29.2 1.0X +make_date(2019, 9, 16) 2322 2371 61 43.1 23.2 1.3X +make_date(*, *, *) 4553 4560 6 22.0 45.5 0.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_timestamp() 3189 3197 9 0.3 3189.4 1.0X -make_timestamp(2019, 1, 2, 3, 4, 50.123456) 42 43 1 23.6 42.3 75.3X -make_timestamp(2019, 1, 2, 3, 4, 60.000000) 40 41 0 24.8 40.3 79.2X -make_timestamp(2019, 12, 31, 23, 59, 60.00) 39 40 1 25.5 39.2 81.5X -make_timestamp(*, *, *, 3, 4, 50.123456) 197 199 2 5.1 197.1 16.2X -make_timestamp(*, *, *, *, *, 0) 194 196 2 5.2 193.8 16.5X -make_timestamp(*, *, *, *, *, 60.0) 195 196 1 5.1 195.3 16.3X -make_timestamp(2019, 1, 2, *, *, *) 3300 3304 6 0.3 3299.9 1.0X -make_timestamp(*, *, *, *, *, *) 3316 3317 1 0.3 3316.0 1.0X +prepare make_timestamp() 3636 3673 38 0.3 3635.7 1.0X +make_timestamp(2019, 1, 2, 3, 4, 50.123456) 94 99 4 10.7 93.8 38.8X +make_timestamp(2019, 1, 2, 3, 4, 60.000000) 68 80 13 14.6 68.3 53.2X +make_timestamp(2019, 12, 31, 23, 59, 60.00) 65 79 19 15.3 65.3 55.7X +make_timestamp(*, *, *, 3, 4, 50.123456) 271 280 14 3.7 270.7 13.4X +make_timestamp(*, *, *, *, *, 0) 255 263 11 3.9 255.5 14.2X +make_timestamp(*, *, *, *, *, 60.0) 254 258 4 3.9 254.2 14.3X +make_timestamp(2019, 1, 2, *, *, *) 3714 3722 8 0.3 3713.9 1.0X +make_timestamp(*, *, *, *, *, *) 3736 3741 6 0.3 3736.3 1.0X diff --git a/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt b/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt index a523dde17dee9..281b0fe28171b 100644 --- a/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt @@ -2,126 +2,126 @@ filter & aggregate without group ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/filter/sum wholestage off 43660 44530 1230 48.0 20.8 1.0X -range/filter/sum wholestage on 2821 2909 50 743.5 1.3 15.5X +range/filter/sum wholestage off 54616 54834 309 38.4 26.0 1.0X +range/filter/sum wholestage on 3263 3369 129 642.6 1.6 16.7X ================================================================================================ range/limit/sum ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/limit/sum wholestage off 115 166 71 4558.5 0.2 1.0X -range/limit/sum wholestage on 51 52 0 10241.0 0.1 2.2X +range/limit/sum wholestage off 239 265 36 2190.0 0.5 1.0X +range/limit/sum wholestage on 137 162 15 3814.6 0.3 1.7X ================================================================================================ sample ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sample with replacement wholestage off 11193 11615 597 11.7 85.4 1.0X -sample with replacement wholestage on 6724 6850 96 19.5 51.3 1.7X +sample with replacement wholestage off 13093 13417 458 10.0 99.9 1.0X +sample with replacement wholestage on 7606 7624 13 17.2 58.0 1.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sample without replacement wholestage off 2133 2133 1 61.5 16.3 1.0X -sample without replacement wholestage on 886 900 8 148.0 6.8 2.4X +sample without replacement wholestage off 3031 3038 9 43.2 23.1 1.0X +sample without replacement wholestage on 1156 1177 16 113.4 8.8 2.6X ================================================================================================ collect ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect 1 million 235 248 21 4.5 224.5 1.0X -collect 2 millions 454 481 35 2.3 433.4 0.5X -collect 4 millions 1049 1075 37 1.0 1000.6 0.2X +collect 1 million 335 360 20 3.1 319.0 1.0X +collect 2 millions 579 633 42 1.8 552.2 0.6X +collect 4 millions 1192 1331 196 0.9 1137.1 0.3X ================================================================================================ collect limit ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect limit 1 million 287 293 6 3.7 273.3 1.0X -collect limit 2 millions 552 570 32 1.9 526.2 0.5X +collect limit 1 million 378 386 12 2.8 360.8 1.0X +collect limit 2 millions 724 733 12 1.4 690.3 0.5X ================================================================================================ generate explode ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode array wholestage off 10497 10665 237 1.6 625.7 1.0X -generate explode array wholestage on 10782 10827 37 1.6 642.7 1.0X +generate explode array wholestage off 15880 16159 395 1.1 946.5 1.0X +generate explode array wholestage on 15690 15783 73 1.1 935.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode map wholestage off 40309 40415 151 0.4 2402.6 1.0X -generate explode map wholestage on 40042 40762 500 0.4 2386.7 1.0X +generate explode map wholestage off 51293 51311 26 0.3 3057.3 1.0X +generate explode map wholestage on 50409 50795 388 0.3 3004.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate posexplode array wholestage off 12252 12289 51 1.4 730.3 1.0X -generate posexplode array wholestage on 12109 12146 30 1.4 721.8 1.0X +generate posexplode array wholestage off 17246 17860 869 1.0 1027.9 1.0X +generate posexplode array wholestage on 17344 17472 88 1.0 1033.8 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate inline array wholestage off 9570 9729 225 1.8 570.4 1.0X -generate inline array wholestage on 9123 9891 812 1.8 543.8 1.0X +generate inline array wholestage off 13698 13790 130 1.2 816.5 1.0X +generate inline array wholestage on 12995 13033 38 1.3 774.6 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate big struct array wholestage off 351 378 38 0.2 5846.3 1.0X -generate big struct array wholestage on 329 334 6 0.2 5486.3 1.1X +generate big struct array wholestage off 476 489 18 0.1 7938.6 1.0X +generate big struct array wholestage on 424 440 14 0.1 7074.9 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate big nested struct array wholestage off 333 340 9 0.2 5556.2 1.0X -generate big nested struct array wholestage on 330 335 4 0.2 5496.3 1.0X +generate big nested struct array wholestage off 413 433 28 0.1 6886.8 1.0X +generate big nested struct array wholestage on 394 420 39 0.2 6560.9 1.0X ================================================================================================ generate regular generator ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate stack wholestage off 22190 22685 701 0.8 1322.6 1.0X -generate stack wholestage on 21491 22900 1331 0.8 1281.0 1.0X +generate stack wholestage off 26494 26510 23 0.6 1579.2 1.0X +generate stack wholestage on 24205 24339 80 0.7 1442.8 1.1X diff --git a/sql/core/benchmarks/MiscBenchmark-results.txt b/sql/core/benchmarks/MiscBenchmark-results.txt index e64ca5513bc92..8b1e728ed9cf9 100644 --- a/sql/core/benchmarks/MiscBenchmark-results.txt +++ b/sql/core/benchmarks/MiscBenchmark-results.txt @@ -2,126 +2,126 @@ filter & aggregate without group ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/filter/sum wholestage off 39674 39693 27 52.9 18.9 1.0X -range/filter/sum wholestage on 3057 3083 36 685.9 1.5 13.0X +range/filter/sum wholestage off 46812 48110 1836 44.8 22.3 1.0X +range/filter/sum wholestage on 3116 3656 309 673.1 1.5 15.0X ================================================================================================ range/limit/sum ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/limit/sum wholestage off 109 118 12 4788.2 0.2 1.0X -range/limit/sum wholestage on 43 45 2 12328.2 0.1 2.6X +range/limit/sum wholestage off 200 219 27 2621.6 0.4 1.0X +range/limit/sum wholestage on 117 125 7 4477.8 0.2 1.7X ================================================================================================ sample ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sample with replacement wholestage off 10535 11120 826 12.4 80.4 1.0X -sample with replacement wholestage on 6582 6769 138 19.9 50.2 1.6X +sample with replacement wholestage off 12963 13506 768 10.1 98.9 1.0X +sample with replacement wholestage on 7397 7742 300 17.7 56.4 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sample without replacement wholestage off 2066 2067 1 63.4 15.8 1.0X -sample without replacement wholestage on 875 876 1 149.7 6.7 2.4X +sample without replacement wholestage off 2977 2977 0 44.0 22.7 1.0X +sample without replacement wholestage on 1087 1099 13 120.6 8.3 2.7X ================================================================================================ collect ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect 1 million 219 235 27 4.8 208.6 1.0X -collect 2 millions 420 444 51 2.5 400.9 0.5X -collect 4 millions 836 904 95 1.3 797.2 0.3X +collect 1 million 281 315 34 3.7 268.2 1.0X +collect 2 millions 531 564 28 2.0 506.6 0.5X +collect 4 millions 1179 1970 1118 0.9 1124.5 0.2X ================================================================================================ collect limit ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect limit 1 million 270 275 9 3.9 257.4 1.0X -collect limit 2 millions 521 528 8 2.0 497.1 0.5X +collect limit 1 million 344 352 5 3.0 328.0 1.0X +collect limit 2 millions 656 660 6 1.6 625.2 0.5X ================================================================================================ generate explode ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode array wholestage off 11409 11484 105 1.5 680.1 1.0X -generate explode array wholestage on 11519 11578 61 1.5 686.6 1.0X +generate explode array wholestage off 14664 14780 164 1.1 874.0 1.0X +generate explode array wholestage on 14789 14886 87 1.1 881.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode map wholestage off 39318 39450 186 0.4 2343.5 1.0X -generate explode map wholestage on 39004 39156 96 0.4 2324.8 1.0X +generate explode map wholestage off 50441 51014 811 0.3 3006.5 1.0X +generate explode map wholestage on 49164 49915 892 0.3 2930.4 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate posexplode array wholestage off 12913 12971 82 1.3 769.7 1.0X -generate posexplode array wholestage on 12770 12858 73 1.3 761.2 1.0X +generate posexplode array wholestage off 17101 17130 40 1.0 1019.3 1.0X +generate posexplode array wholestage on 15625 15675 46 1.1 931.3 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate inline array wholestage off 8919 8930 17 1.9 531.6 1.0X -generate inline array wholestage on 8842 8874 26 1.9 527.0 1.0X +generate inline array wholestage off 13923 14720 1127 1.2 829.9 1.0X +generate inline array wholestage on 12246 12591 695 1.4 729.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate big struct array wholestage off 324 339 22 0.2 5396.2 1.0X -generate big struct array wholestage on 320 326 6 0.2 5337.2 1.0X +generate big struct array wholestage off 442 456 20 0.1 7368.2 1.0X +generate big struct array wholestage on 409 429 22 0.1 6823.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate big nested struct array wholestage off 317 322 7 0.2 5285.0 1.0X -generate big nested struct array wholestage on 317 322 7 0.2 5285.3 1.0X +generate big nested struct array wholestage off 409 415 8 0.1 6822.4 1.0X +generate big nested struct array wholestage on 401 414 23 0.1 6687.0 1.0X ================================================================================================ generate regular generator ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate stack wholestage off 21051 21081 43 0.8 1254.7 1.0X -generate stack wholestage on 19568 19628 71 0.9 1166.4 1.1X +generate stack wholestage off 27043 27118 106 0.6 1611.9 1.0X +generate stack wholestage on 24002 24036 34 0.7 1430.6 1.1X diff --git a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt index c5da99754ace8..c286dc2da8076 100644 --- a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v1 ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 70 76 4 14.2 70.3 1.0X -Nested column 1951 1963 9 0.5 1950.6 0.0X -Nested column in array 3733 3769 36 0.3 3732.6 0.0X +Top-level column 155 197 23 6.5 155.0 1.0X +Nested column 1290 1338 43 0.8 1289.9 0.1X +Nested column in array 5914 5989 57 0.2 5914.1 0.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 345 365 27 2.9 345.4 1.0X -Nested column 1755 1770 12 0.6 1755.1 0.2X -Nested column in array 4622 4660 34 0.2 4621.7 0.1X +Top-level column 463 537 53 2.2 463.2 1.0X +Nested column 1807 1874 62 0.6 1807.3 0.3X +Nested column in array 6729 6906 116 0.1 6729.4 0.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 301 306 3 3.3 301.4 1.0X -Nested column 1719 1727 8 0.6 1719.1 0.2X -Nested column in array 4574 4608 28 0.2 4573.7 0.1X +Top-level column 378 402 18 2.6 377.7 1.0X +Nested column 1765 1794 46 0.6 1765.4 0.2X +Nested column in array 6675 6718 42 0.1 6674.6 0.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 304 307 2 3.3 304.0 1.0X -Nested column 3346 3417 49 0.3 3345.8 0.1X -Nested column in array 6611 6685 39 0.2 6610.9 0.0X +Top-level column 384 399 8 2.6 383.7 1.0X +Nested column 4724 4820 72 0.2 4724.3 0.1X +Nested column in array 9256 9405 133 0.1 9255.7 0.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 86 89 2 11.6 86.1 1.0X -Nested column 854 860 5 1.2 853.9 0.1X -Nested column in array 3512 3531 20 0.3 3512.3 0.0X +Top-level column 121 137 13 8.3 120.7 1.0X +Nested column 1303 1361 45 0.8 1303.2 0.1X +Nested column in array 5901 5978 49 0.2 5901.0 0.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 444 448 5 2.2 444.5 1.0X -Nested column 3781 3824 30 0.3 3780.9 0.1X -Nested column in array 7204 7380 78 0.1 7204.4 0.1X +Top-level column 651 675 30 1.5 650.8 1.0X +Nested column 5398 5527 179 0.2 5397.9 0.1X +Nested column in array 10413 10685 310 0.1 10413.1 0.1X diff --git a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt index 0d04d8e63d55f..0cbd855ec5e3a 100644 --- a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v1 ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 60 64 5 16.6 60.2 1.0X -Nested column 1405 1525 62 0.7 1405.0 0.0X -Nested column in array 3536 3573 19 0.3 3536.1 0.0X +Top-level column 116 148 22 8.6 115.9 1.0X +Nested column 1200 1221 23 0.8 1200.3 0.1X +Nested column in array 4786 4898 202 0.2 4785.6 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 298 303 4 3.4 297.9 1.0X -Nested column 1696 1754 24 0.6 1696.0 0.2X -Nested column in array 4012 4033 16 0.2 4011.7 0.1X +Top-level column 428 452 18 2.3 427.7 1.0X +Nested column 1681 1725 53 0.6 1680.7 0.3X +Nested column in array 5652 5699 47 0.2 5651.9 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 262 269 9 3.8 262.4 1.0X -Nested column 1734 1745 5 0.6 1734.2 0.2X -Nested column in array 3956 3970 12 0.3 3956.0 0.1X +Top-level column 341 351 15 2.9 340.9 1.0X +Nested column 1529 1559 31 0.7 1528.6 0.2X +Nested column in array 5468 5517 97 0.2 5468.2 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 268 271 4 3.7 267.7 1.0X -Nested column 3657 3678 16 0.3 3656.9 0.1X -Nested column in array 5975 5996 21 0.2 5975.3 0.0X +Top-level column 353 365 12 2.8 352.5 1.0X +Nested column 4135 4171 23 0.2 4135.2 0.1X +Nested column in array 8766 8816 56 0.1 8766.0 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 78 81 3 12.8 77.8 1.0X -Nested column 1365 1379 13 0.7 1365.3 0.1X -Nested column in array 3544 3562 16 0.3 3544.3 0.0X +Top-level column 115 133 25 8.7 115.3 1.0X +Nested column 1200 1216 13 0.8 1199.7 0.1X +Nested column in array 5296 5345 39 0.2 5296.3 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 398 409 13 2.5 398.0 1.0X -Nested column 4100 4156 88 0.2 4099.7 0.1X -Nested column in array 6694 6747 33 0.1 6694.0 0.1X +Top-level column 545 560 14 1.8 544.7 1.0X +Nested column 4704 4813 184 0.2 4703.8 0.1X +Nested column in array 9785 9824 42 0.1 9784.8 0.1X diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt index a00cd99036c6a..31970672aacd4 100644 --- a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v2 ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 77 84 7 12.9 77.4 1.0X -Nested column 1243 1261 9 0.8 1242.8 0.1X -Nested column in array 3533 3571 33 0.3 3532.9 0.0X +Top-level column 176 207 20 5.7 176.2 1.0X +Nested column 1173 1212 61 0.9 1173.2 0.2X +Nested column in array 5557 5628 58 0.2 5557.5 0.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 92 96 3 10.9 91.7 1.0X -Nested column 1000 1015 20 1.0 1000.4 0.1X -Nested column in array 3498 3567 40 0.3 3497.9 0.0X +Top-level column 143 178 21 7.0 143.5 1.0X +Nested column 1233 1272 31 0.8 1233.0 0.1X +Nested column in array 5585 5691 66 0.2 5585.4 0.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 313 321 4 3.2 313.1 1.0X -Nested column 1314 1325 9 0.8 1314.0 0.2X -Nested column in array 4510 4555 33 0.2 4510.0 0.1X +Top-level column 395 416 23 2.5 395.4 1.0X +Nested column 1665 1691 16 0.6 1664.7 0.2X +Nested column in array 6194 6307 183 0.2 6194.5 0.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 322 325 2 3.1 322.3 1.0X -Nested column 3599 3676 55 0.3 3599.0 0.1X -Nested column in array 6528 6608 53 0.2 6527.6 0.0X +Top-level column 394 407 14 2.5 393.7 1.0X +Nested column 4381 4536 97 0.2 4380.6 0.1X +Nested column in array 8797 8833 34 0.1 8796.7 0.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 88 100 15 11.3 88.2 1.0X -Nested column 982 998 14 1.0 982.4 0.1X -Nested column in array 3437 3478 31 0.3 3436.6 0.0X +Top-level column 136 170 24 7.4 135.6 1.0X +Nested column 1135 1171 30 0.9 1135.0 0.1X +Nested column in array 4833 4911 92 0.2 4833.3 0.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 196 201 8 5.1 196.1 1.0X -Nested column 2533 2583 89 0.4 2533.4 0.1X -Nested column in array 5964 6094 135 0.2 5964.0 0.0X +Top-level column 327 336 8 3.1 327.0 1.0X +Nested column 3321 3377 56 0.3 3321.0 0.1X +Nested column in array 8080 8161 97 0.1 8080.4 0.0X diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt index 528ac0c88b6ee..c7d8c8a541b59 100644 --- a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v2 ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 66 71 5 15.2 65.6 1.0X -Nested column 760 768 5 1.3 759.7 0.1X -Nested column in array 4276 4288 11 0.2 4276.2 0.0X +Top-level column 121 156 27 8.3 121.1 1.0X +Nested column 1373 1406 37 0.7 1373.4 0.1X +Nested column in array 5545 5579 54 0.2 5544.8 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 80 85 5 12.5 79.7 1.0X -Nested column 1240 1248 7 0.8 1240.0 0.1X -Nested column in array 4776 4794 14 0.2 4776.3 0.0X +Top-level column 127 147 20 7.9 127.0 1.0X +Nested column 1280 1328 32 0.8 1280.2 0.1X +Nested column in array 5617 5696 70 0.2 5617.0 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 279 286 8 3.6 278.6 1.0X -Nested column 1539 1553 8 0.6 1538.8 0.2X -Nested column in array 5178 5193 8 0.2 5178.3 0.1X +Top-level column 343 356 17 2.9 342.6 1.0X +Nested column 1692 1710 14 0.6 1692.3 0.2X +Nested column in array 6128 6168 30 0.2 6128.0 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 283 291 9 3.5 283.4 1.0X -Nested column 3122 3146 14 0.3 3122.3 0.1X -Nested column in array 6927 6941 11 0.1 6926.9 0.0X +Top-level column 348 355 11 2.9 348.1 1.0X +Nested column 4350 4392 35 0.2 4349.8 0.1X +Nested column in array 8864 8901 29 0.1 8864.1 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 84 87 6 12.0 83.6 1.0X -Nested column 881 894 16 1.1 881.4 0.1X -Nested column in array 4289 4306 15 0.2 4288.5 0.0X +Top-level column 123 143 27 8.2 122.5 1.0X +Nested column 1233 1295 29 0.8 1233.2 0.1X +Nested column in array 5534 5597 53 0.2 5533.7 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 178 182 7 5.6 177.6 1.0X -Nested column 2247 2284 33 0.4 2247.1 0.1X -Nested column in array 6503 6577 84 0.2 6503.4 0.0X +Top-level column 265 280 20 3.8 264.8 1.0X +Nested column 3211 3263 96 0.3 3211.2 0.1X +Nested column in array 8324 8357 42 0.1 8323.6 0.0X diff --git a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt index 6ddaa50978f74..f6135968bb97b 100644 --- a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For Parquet ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 80 86 4 12.4 80.5 1.0X -Nested column 229 233 3 4.4 228.7 0.4X -Nested column in array 1064 1097 29 0.9 1064.3 0.1X +Top-level column 150 218 36 6.6 150.5 1.0X +Nested column 294 334 39 3.4 293.8 0.5X +Nested column in array 994 1024 34 1.0 994.3 0.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 96 100 3 10.4 96.3 1.0X -Nested column 271 274 4 3.7 270.6 0.4X -Nested column in array 1148 1177 48 0.9 1147.5 0.1X +Top-level column 161 183 13 6.2 160.9 1.0X +Nested column 296 332 43 3.4 295.6 0.5X +Nested column in array 1048 1089 48 1.0 1047.9 0.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 325 331 5 3.1 325.2 1.0X -Nested column 554 562 5 1.8 554.4 0.6X -Nested column in array 1564 1568 5 0.6 1563.7 0.2X +Top-level column 393 411 16 2.5 393.1 1.0X +Nested column 550 563 9 1.8 549.9 0.7X +Nested column in array 1468 1494 20 0.7 1467.5 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 331 333 2 3.0 330.8 1.0X -Nested column 2724 2736 9 0.4 2723.9 0.1X -Nested column in array 3153 3169 15 0.3 3152.9 0.1X +Top-level column 404 419 15 2.5 404.2 1.0X +Nested column 2833 2875 24 0.4 2832.8 0.1X +Nested column in array 3340 3396 53 0.3 3340.3 0.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 98 102 7 10.2 97.8 1.0X -Nested column 280 287 5 3.6 279.7 0.3X -Nested column in array 1187 1210 22 0.8 1186.9 0.1X +Top-level column 142 159 12 7.0 142.3 1.0X +Nested column 308 318 8 3.2 307.8 0.5X +Nested column in array 1119 1154 32 0.9 1118.5 0.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 199 202 8 5.0 198.7 1.0X -Nested column 1742 1764 19 0.6 1741.9 0.1X -Nested column in array 2662 2756 134 0.4 2662.1 0.1X +Top-level column 338 342 2 3.0 338.0 1.0X +Nested column 1873 1971 129 0.5 1873.1 0.2X +Nested column in array 2708 2760 50 0.4 2707.9 0.1X diff --git a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt index 6662d4d62e7e5..9f64e0425df8d 100644 --- a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For Parquet ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 72 78 6 13.9 71.9 1.0X -Nested column 231 235 3 4.3 231.4 0.3X -Nested column in array 1154 1162 6 0.9 1153.6 0.1X +Top-level column 136 157 19 7.3 136.3 1.0X +Nested column 254 267 8 3.9 254.3 0.5X +Nested column in array 1071 1089 18 0.9 1071.1 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 87 92 4 11.6 86.5 1.0X -Nested column 270 278 7 3.7 270.0 0.3X -Nested column in array 1167 1181 13 0.9 1167.1 0.1X +Top-level column 134 147 12 7.5 134.1 1.0X +Nested column 288 295 5 3.5 287.7 0.5X +Nested column in array 1104 1135 35 0.9 1104.1 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 280 285 5 3.6 279.9 1.0X -Nested column 489 495 4 2.0 489.1 0.6X -Nested column in array 1542 1553 11 0.6 1542.1 0.2X +Top-level column 361 372 14 2.8 361.1 1.0X +Nested column 522 535 16 1.9 521.8 0.7X +Nested column in array 1540 1553 11 0.6 1539.6 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 288 292 4 3.5 287.7 1.0X -Nested column 2391 2405 11 0.4 2391.1 0.1X -Nested column in array 2858 2875 15 0.3 2858.4 0.1X +Top-level column 375 384 11 2.7 374.6 1.0X +Nested column 2686 2715 24 0.4 2686.2 0.1X +Nested column in array 3067 3080 13 0.3 3067.2 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 90 92 3 11.1 89.9 1.0X -Nested column 289 294 4 3.5 288.8 0.3X -Nested column in array 1164 1177 10 0.9 1163.8 0.1X +Top-level column 120 135 8 8.3 120.3 1.0X +Nested column 280 290 13 3.6 279.9 0.4X +Nested column in array 1114 1143 29 0.9 1114.2 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 184 191 8 5.4 184.3 1.0X -Nested column 1577 1670 102 0.6 1577.0 0.1X -Nested column in array 2468 2479 12 0.4 2467.9 0.1X +Top-level column 263 277 18 3.8 263.0 1.0X +Nested column 1724 1763 38 0.6 1724.1 0.2X +Nested column in array 2530 2605 65 0.4 2529.9 0.1X diff --git a/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt b/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt index d82112952d064..44109e406ebb6 100644 --- a/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt @@ -2,14 +2,14 @@ range ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -full scan 8302 8836 1059 63.2 15.8 1.0X -limit after range 35 38 5 14924.4 0.1 236.3X -filter after range 1140 1143 3 459.8 2.2 7.3X -count after range 45 46 1 11729.5 0.1 185.7X -count after limit after range 36 37 1 14764.1 0.1 233.8X +full scan 11004 11558 944 47.6 21.0 1.0X +limit after range 121 135 19 4320.4 0.2 90.7X +filter after range 1529 1544 23 342.9 2.9 7.2X +count after range 123 143 21 4268.5 0.2 89.6X +count after limit after range 115 123 6 4547.6 0.2 95.4X diff --git a/sql/core/benchmarks/RangeBenchmark-results.txt b/sql/core/benchmarks/RangeBenchmark-results.txt index b192050e1a445..e006785e7a2ca 100644 --- a/sql/core/benchmarks/RangeBenchmark-results.txt +++ b/sql/core/benchmarks/RangeBenchmark-results.txt @@ -2,14 +2,14 @@ range ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -full scan 8453 8812 624 62.0 16.1 1.0X -limit after range 28 30 2 18549.3 0.1 299.1X -filter after range 1065 1068 1 492.1 2.0 7.9X -count after range 46 47 1 11314.0 0.1 182.4X -count after limit after range 31 31 1 17008.0 0.1 274.2X +full scan 11565 11703 217 45.3 22.1 1.0X +limit after range 96 100 4 5455.9 0.2 120.3X +filter after range 1426 1432 10 367.7 2.7 8.1X +count after range 82 84 2 6412.8 0.2 141.5X +count after limit after range 72 76 3 7264.9 0.1 160.2X diff --git a/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt b/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt index 2ba3e78d3d07e..79daf73a95bb4 100644 --- a/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt @@ -2,58 +2,58 @@ UDF with mixed input types ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to string wholestage off 124 148 33 0.8 1240.0 1.0X -long/nullable int/string to string wholestage on 57 63 5 1.8 571.2 2.2X +long/nullable int/string to string wholestage off 279 320 58 0.4 2789.3 1.0X +long/nullable int/string to string wholestage on 182 188 7 0.6 1818.0 1.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to option wholestage off 39 40 0 2.5 392.2 1.0X -long/nullable int/string to option wholestage on 35 44 8 2.9 350.6 1.1X +long/nullable int/string to option wholestage off 133 137 5 0.8 1332.3 1.0X +long/nullable int/string to option wholestage on 110 118 8 0.9 1097.3 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to primitive wholestage off 34 35 1 3.0 335.1 1.0X -long/nullable int/string to primitive wholestage on 33 34 1 3.0 328.3 1.0X +long/nullable int/string to primitive wholestage off 69 83 19 1.4 694.7 1.0X +long/nullable int/string to primitive wholestage on 66 81 18 1.5 657.5 1.1X ================================================================================================ UDF with primitive types ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to string wholestage off 39 40 0 2.5 394.8 1.0X -long/nullable int to string wholestage on 39 40 1 2.5 392.8 1.0X +long/nullable int to string wholestage off 76 80 5 1.3 761.5 1.0X +long/nullable int to string wholestage on 65 67 2 1.5 654.2 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to option wholestage off 25 25 0 3.9 253.7 1.0X -long/nullable int to option wholestage on 26 26 1 3.9 257.9 1.0X +long/nullable int to option wholestage off 49 50 2 2.0 487.9 1.0X +long/nullable int to option wholestage on 50 66 12 2.0 503.6 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to primitive wholestage off 26 27 1 3.8 262.4 1.0X -long/nullable int to primitive wholestage on 29 30 1 3.4 293.2 0.9X +long/nullable int to primitive wholestage off 48 58 14 2.1 483.5 1.0X +long/nullable int to primitive wholestage on 46 52 6 2.2 456.8 1.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Baseline 21 22 1 4.8 209.4 1.0X -With identity UDF 24 25 1 4.1 242.9 0.9X +Baseline 39 41 3 2.6 385.8 1.0X +With identity UDF 44 46 3 2.3 444.4 0.9X diff --git a/sql/core/benchmarks/UDFBenchmark-results.txt b/sql/core/benchmarks/UDFBenchmark-results.txt index 0d640dacbc4e0..3f17a999094a3 100644 --- a/sql/core/benchmarks/UDFBenchmark-results.txt +++ b/sql/core/benchmarks/UDFBenchmark-results.txt @@ -2,58 +2,58 @@ UDF with mixed input types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to string wholestage off 117 133 24 0.9 1167.2 1.0X -long/nullable int/string to string wholestage on 78 99 22 1.3 784.6 1.5X +long/nullable int/string to string wholestage off 250 327 108 0.4 2500.6 1.0X +long/nullable int/string to string wholestage on 142 157 16 0.7 1421.2 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to option wholestage off 43 43 0 2.3 427.8 1.0X -long/nullable int/string to option wholestage on 41 43 2 2.4 413.1 1.0X +long/nullable int/string to option wholestage off 124 125 2 0.8 1237.8 1.0X +long/nullable int/string to option wholestage on 73 93 27 1.4 730.1 1.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int/string to primitive wholestage off 38 38 0 2.6 381.7 1.0X -long/nullable int/string to primitive wholestage on 37 44 14 2.7 372.2 1.0X +long/nullable int/string to primitive wholestage off 66 69 4 1.5 658.8 1.0X +long/nullable int/string to primitive wholestage on 61 67 11 1.6 611.7 1.1X ================================================================================================ UDF with primitive types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to string wholestage off 40 40 1 2.5 398.9 1.0X -long/nullable int to string wholestage on 42 42 0 2.4 417.1 1.0X +long/nullable int to string wholestage off 66 67 0 1.5 663.9 1.0X +long/nullable int to string wholestage on 66 68 2 1.5 664.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to option wholestage off 23 23 0 4.4 226.6 1.0X -long/nullable int to option wholestage on 23 24 0 4.3 231.1 1.0X +long/nullable int to option wholestage off 40 42 3 2.5 402.6 1.0X +long/nullable int to option wholestage on 40 42 2 2.5 401.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -long/nullable int to primitive wholestage off 24 24 0 4.2 238.6 1.0X -long/nullable int to primitive wholestage on 22 23 1 4.4 225.0 1.1X +long/nullable int to primitive wholestage off 38 39 0 2.6 384.8 1.0X +long/nullable int to primitive wholestage on 39 45 5 2.5 392.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Baseline 18 19 1 5.5 182.3 1.0X -With identity UDF 22 22 0 4.5 220.1 0.8X +Baseline 32 33 1 3.1 320.8 1.0X +With identity UDF 37 40 6 2.7 369.1 0.9X diff --git a/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt b/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt index 4e07d3019e840..19ce183820c05 100644 --- a/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt @@ -2,144 +2,144 @@ parsing large select expressions ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 select expressions 1 3 2 0.0 1420496.0 1.0X -100 select expressions 9 9 0 0.0 8915229.0 0.2X -2500 select expressions 194 198 4 0.0 194019261.0 0.0X +1 select expressions 8 15 8 0.0 8028037.0 1.0X +100 select expressions 15 18 3 0.0 14899892.0 0.5X +2500 select expressions 237 243 8 0.0 237252523.0 0.0X ================================================================================================ many column field read and write ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 cols x 100000 rows (read in-mem) 23 26 2 4.3 232.9 1.0X -1 cols x 100000 rows (exec in-mem) 29 31 2 3.5 289.7 0.8X -1 cols x 100000 rows (read parquet) 38 39 1 2.7 375.4 0.6X -1 cols x 100000 rows (write parquet) 102 105 2 1.0 1018.5 0.2X -100 cols x 1000 rows (read in-mem) 39 40 1 2.6 388.4 0.6X -100 cols x 1000 rows (exec in-mem) 55 57 1 1.8 552.4 0.4X -100 cols x 1000 rows (read parquet) 46 49 2 2.2 463.4 0.5X -100 cols x 1000 rows (write parquet) 117 120 2 0.9 1172.4 0.2X -2500 cols x 40 rows (read in-mem) 422 425 3 0.2 4223.4 0.1X -2500 cols x 40 rows (exec in-mem) 698 712 13 0.1 6976.9 0.0X -2500 cols x 40 rows (read parquet) 298 300 2 0.3 2983.1 0.1X -2500 cols x 40 rows (write parquet) 490 493 3 0.2 4895.7 0.0X +1 cols x 100000 rows (read in-mem) 59 72 8 1.7 591.0 1.0X +1 cols x 100000 rows (exec in-mem) 57 81 15 1.8 566.0 1.0X +1 cols x 100000 rows (read parquet) 61 78 13 1.6 614.8 1.0X +1 cols x 100000 rows (write parquet) 147 158 10 0.7 1468.5 0.4X +100 cols x 1000 rows (read in-mem) 57 62 6 1.8 565.8 1.0X +100 cols x 1000 rows (exec in-mem) 76 83 10 1.3 758.7 0.8X +100 cols x 1000 rows (read parquet) 70 79 10 1.4 700.8 0.8X +100 cols x 1000 rows (write parquet) 150 162 11 0.7 1498.8 0.4X +2500 cols x 40 rows (read in-mem) 413 424 15 0.2 4134.4 0.1X +2500 cols x 40 rows (exec in-mem) 753 772 23 0.1 7528.2 0.1X +2500 cols x 40 rows (read parquet) 304 312 8 0.3 3044.6 0.2X +2500 cols x 40 rows (write parquet) 507 520 11 0.2 5069.3 0.1X ================================================================================================ wide shallowly nested struct field read and write ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 33 36 3 3.0 334.8 1.0X -1 wide x 100000 rows (exec in-mem) 45 47 3 2.2 450.4 0.7X -1 wide x 100000 rows (read parquet) 70 74 5 1.4 696.3 0.5X -1 wide x 100000 rows (write parquet) 112 113 1 0.9 1115.4 0.3X -100 wide x 1000 rows (read in-mem) 44 46 2 2.3 443.1 0.8X -100 wide x 1000 rows (exec in-mem) 83 86 5 1.2 832.0 0.4X -100 wide x 1000 rows (read parquet) 106 108 2 0.9 1055.0 0.3X -100 wide x 1000 rows (write parquet) 122 124 2 0.8 1220.4 0.3X -2500 wide x 40 rows (read in-mem) 54 55 1 1.8 540.8 0.6X -2500 wide x 40 rows (exec in-mem) 801 804 3 0.1 8010.1 0.0X -2500 wide x 40 rows (read parquet) 1086 1093 9 0.1 10863.0 0.0X -2500 wide x 40 rows (write parquet) 131 137 9 0.8 1310.7 0.3X +1 wide x 100000 rows (read in-mem) 54 63 8 1.8 540.7 1.0X +1 wide x 100000 rows (exec in-mem) 67 77 11 1.5 671.8 0.8X +1 wide x 100000 rows (read parquet) 90 97 6 1.1 901.2 0.6X +1 wide x 100000 rows (write parquet) 150 163 11 0.7 1503.9 0.4X +100 wide x 1000 rows (read in-mem) 69 75 8 1.4 689.8 0.8X +100 wide x 1000 rows (exec in-mem) 111 148 96 0.9 1111.5 0.5X +100 wide x 1000 rows (read parquet) 181 241 35 0.6 1808.7 0.3X +100 wide x 1000 rows (write parquet) 164 180 27 0.6 1636.1 0.3X +2500 wide x 40 rows (read in-mem) 78 101 84 1.3 781.0 0.7X +2500 wide x 40 rows (exec in-mem) 943 966 37 0.1 9430.9 0.1X +2500 wide x 40 rows (read parquet) 1385 1453 95 0.1 13853.3 0.0X +2500 wide x 40 rows (write parquet) 175 190 19 0.6 1745.5 0.3X ================================================================================================ deeply nested struct field read and write ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 deep x 100000 rows (read in-mem) 29 31 1 3.4 293.0 1.0X -1 deep x 100000 rows (exec in-mem) 36 37 2 2.8 362.4 0.8X -1 deep x 100000 rows (read parquet) 44 45 1 2.3 441.8 0.7X -1 deep x 100000 rows (write parquet) 105 106 1 1.0 1050.9 0.3X -100 deep x 1000 rows (read in-mem) 444 445 2 0.2 4436.0 0.1X -100 deep x 1000 rows (exec in-mem) 1710 1711 0 0.1 17104.4 0.0X -100 deep x 1000 rows (read parquet) 1622 1622 0 0.1 16221.9 0.0X -100 deep x 1000 rows (write parquet) 520 521 2 0.2 5197.6 0.1X -250 deep x 400 rows (read in-mem) 2470 2470 1 0.0 24697.3 0.0X -250 deep x 400 rows (exec in-mem) 10329 10329 1 0.0 103287.1 0.0X -250 deep x 400 rows (read parquet) 9720 9736 21 0.0 97204.5 0.0X -250 deep x 400 rows (write parquet) 2544 2544 0 0.0 25437.2 0.0X +1 deep x 100000 rows (read in-mem) 44 49 6 2.3 441.1 1.0X +1 deep x 100000 rows (exec in-mem) 54 59 6 1.9 536.4 0.8X +1 deep x 100000 rows (read parquet) 65 68 6 1.5 646.1 0.7X +1 deep x 100000 rows (write parquet) 141 147 9 0.7 1413.9 0.3X +100 deep x 1000 rows (read in-mem) 459 470 11 0.2 4592.9 0.1X +100 deep x 1000 rows (exec in-mem) 1736 1740 6 0.1 17355.1 0.0X +100 deep x 1000 rows (read parquet) 1638 1643 6 0.1 16382.2 0.0X +100 deep x 1000 rows (write parquet) 555 567 12 0.2 5548.4 0.1X +250 deep x 400 rows (read in-mem) 2556 2556 1 0.0 25558.5 0.0X +250 deep x 400 rows (exec in-mem) 10410 10416 8 0.0 104102.6 0.0X +250 deep x 400 rows (read parquet) 9670 9688 26 0.0 96699.1 0.0X +250 deep x 400 rows (write parquet) 2638 2642 5 0.0 26379.7 0.0X ================================================================================================ bushy struct field read and write ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 x 1 deep x 100000 rows (read in-mem) 27 28 1 3.7 270.8 1.0X -1 x 1 deep x 100000 rows (exec in-mem) 34 36 3 3.0 335.1 0.8X -1 x 1 deep x 100000 rows (read parquet) 31 31 1 3.3 305.1 0.9X -1 x 1 deep x 100000 rows (write parquet) 103 105 1 1.0 1032.6 0.3X -128 x 8 deep x 1000 rows (read in-mem) 33 34 1 3.1 327.3 0.8X -128 x 8 deep x 1000 rows (exec in-mem) 135 136 1 0.7 1346.6 0.2X -128 x 8 deep x 1000 rows (read parquet) 134 135 1 0.7 1340.8 0.2X -128 x 8 deep x 1000 rows (write parquet) 109 110 1 0.9 1089.1 0.2X -1024 x 11 deep x 100 rows (read in-mem) 54 55 1 1.9 537.7 0.5X -1024 x 11 deep x 100 rows (exec in-mem) 631 637 5 0.2 6307.6 0.0X -1024 x 11 deep x 100 rows (read parquet) 570 576 4 0.2 5705.0 0.0X -1024 x 11 deep x 100 rows (write parquet) 131 133 1 0.8 1311.5 0.2X +1 x 1 deep x 100000 rows (read in-mem) 39 44 6 2.6 388.2 1.0X +1 x 1 deep x 100000 rows (exec in-mem) 48 50 4 2.1 477.4 0.8X +1 x 1 deep x 100000 rows (read parquet) 47 54 9 2.1 466.1 0.8X +1 x 1 deep x 100000 rows (write parquet) 135 141 5 0.7 1350.5 0.3X +128 x 8 deep x 1000 rows (read in-mem) 45 53 9 2.2 445.2 0.9X +128 x 8 deep x 1000 rows (exec in-mem) 155 160 4 0.6 1553.0 0.2X +128 x 8 deep x 1000 rows (read parquet) 173 217 31 0.6 1729.8 0.2X +128 x 8 deep x 1000 rows (write parquet) 139 154 10 0.7 1389.9 0.3X +1024 x 11 deep x 100 rows (read in-mem) 73 77 4 1.4 730.2 0.5X +1024 x 11 deep x 100 rows (exec in-mem) 733 738 8 0.1 7326.1 0.1X +1024 x 11 deep x 100 rows (read parquet) 652 660 8 0.2 6517.6 0.1X +1024 x 11 deep x 100 rows (write parquet) 171 186 20 0.6 1706.4 0.2X ================================================================================================ wide array field read and write ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 30 31 1 3.4 296.4 1.0X -1 wide x 100000 rows (exec in-mem) 37 38 1 2.7 373.7 0.8X -1 wide x 100000 rows (read parquet) 55 57 4 1.8 551.2 0.5X -1 wide x 100000 rows (write parquet) 105 108 4 1.0 1048.0 0.3X -100 wide x 1000 rows (read in-mem) 25 26 1 4.0 250.6 1.2X -100 wide x 1000 rows (exec in-mem) 32 34 3 3.1 320.3 0.9X -100 wide x 1000 rows (read parquet) 37 38 1 2.7 368.7 0.8X -100 wide x 1000 rows (write parquet) 100 101 1 1.0 1002.1 0.3X -2500 wide x 40 rows (read in-mem) 25 26 3 4.0 247.5 1.2X -2500 wide x 40 rows (exec in-mem) 32 32 1 3.2 315.7 0.9X -2500 wide x 40 rows (read parquet) 36 37 1 2.8 359.6 0.8X -2500 wide x 40 rows (write parquet) 99 100 1 1.0 993.2 0.3X +1 wide x 100000 rows (read in-mem) 43 46 4 2.3 429.7 1.0X +1 wide x 100000 rows (exec in-mem) 54 57 4 1.8 542.4 0.8X +1 wide x 100000 rows (read parquet) 82 87 8 1.2 816.6 0.5X +1 wide x 100000 rows (write parquet) 137 159 19 0.7 1374.9 0.3X +100 wide x 1000 rows (read in-mem) 37 39 4 2.7 367.1 1.2X +100 wide x 1000 rows (exec in-mem) 45 50 6 2.2 451.6 1.0X +100 wide x 1000 rows (read parquet) 52 57 5 1.9 520.8 0.8X +100 wide x 1000 rows (write parquet) 125 131 8 0.8 1247.0 0.3X +2500 wide x 40 rows (read in-mem) 35 39 4 2.9 348.8 1.2X +2500 wide x 40 rows (exec in-mem) 46 49 5 2.2 456.0 0.9X +2500 wide x 40 rows (read parquet) 51 55 6 2.0 508.3 0.8X +2500 wide x 40 rows (write parquet) 129 135 6 0.8 1287.3 0.3X ================================================================================================ wide map field read and write ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 27 27 1 3.8 265.1 1.0X -1 wide x 100000 rows (exec in-mem) 36 36 1 2.8 357.3 0.7X -1 wide x 100000 rows (read parquet) 90 91 1 1.1 896.1 0.3X -1 wide x 100000 rows (write parquet) 102 104 2 1.0 1022.3 0.3X -100 wide x 1000 rows (read in-mem) 19 19 1 5.4 185.7 1.4X -100 wide x 1000 rows (exec in-mem) 26 27 0 3.8 264.0 1.0X -100 wide x 1000 rows (read parquet) 47 47 1 2.1 468.1 0.6X -100 wide x 1000 rows (write parquet) 95 96 1 1.1 945.6 0.3X -2500 wide x 40 rows (read in-mem) 20 21 1 5.0 200.4 1.3X -2500 wide x 40 rows (exec in-mem) 28 28 2 3.6 276.9 1.0X -2500 wide x 40 rows (read parquet) 47 48 2 2.1 465.6 0.6X -2500 wide x 40 rows (write parquet) 95 97 1 1.0 952.5 0.3X +1 wide x 100000 rows (read in-mem) 39 48 9 2.5 394.2 1.0X +1 wide x 100000 rows (exec in-mem) 51 56 9 1.9 514.4 0.8X +1 wide x 100000 rows (read parquet) 119 124 7 0.8 1195.0 0.3X +1 wide x 100000 rows (write parquet) 130 138 8 0.8 1299.8 0.3X +100 wide x 1000 rows (read in-mem) 31 32 3 3.3 306.5 1.3X +100 wide x 1000 rows (exec in-mem) 40 42 3 2.5 402.7 1.0X +100 wide x 1000 rows (read parquet) 65 70 6 1.5 651.8 0.6X +100 wide x 1000 rows (write parquet) 123 129 6 0.8 1228.5 0.3X +2500 wide x 40 rows (read in-mem) 33 37 6 3.0 330.1 1.2X +2500 wide x 40 rows (exec in-mem) 43 44 3 2.3 426.6 0.9X +2500 wide x 40 rows (read parquet) 66 69 9 1.5 657.8 0.6X +2500 wide x 40 rows (write parquet) 123 127 2 0.8 1234.4 0.3X diff --git a/sql/core/benchmarks/WideSchemaBenchmark-results.txt b/sql/core/benchmarks/WideSchemaBenchmark-results.txt index eca1bb1717844..59eb181f6b115 100644 --- a/sql/core/benchmarks/WideSchemaBenchmark-results.txt +++ b/sql/core/benchmarks/WideSchemaBenchmark-results.txt @@ -2,144 +2,144 @@ parsing large select expressions ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 select expressions 1 2 1 0.0 1253919.0 1.0X -100 select expressions 8 8 1 0.0 7663300.0 0.2X -2500 select expressions 176 179 6 0.0 175952808.0 0.0X +1 select expressions 5 13 8 0.0 5370143.0 1.0X +100 select expressions 12 16 6 0.0 11995425.0 0.4X +2500 select expressions 211 214 4 0.0 210927791.0 0.0X ================================================================================================ many column field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 cols x 100000 rows (read in-mem) 19 22 3 5.3 188.8 1.0X -1 cols x 100000 rows (exec in-mem) 23 26 3 4.3 233.9 0.8X -1 cols x 100000 rows (read parquet) 32 34 4 3.2 317.4 0.6X -1 cols x 100000 rows (write parquet) 91 100 26 1.1 914.7 0.2X -100 cols x 1000 rows (read in-mem) 33 33 1 3.1 326.9 0.6X -100 cols x 1000 rows (exec in-mem) 48 49 2 2.1 478.1 0.4X -100 cols x 1000 rows (read parquet) 41 43 4 2.4 410.3 0.5X -100 cols x 1000 rows (write parquet) 105 115 21 1.0 1051.4 0.2X -2500 cols x 40 rows (read in-mem) 360 362 4 0.3 3598.7 0.1X -2500 cols x 40 rows (exec in-mem) 631 633 3 0.2 6309.8 0.0X -2500 cols x 40 rows (read parquet) 279 281 3 0.4 2792.3 0.1X -2500 cols x 40 rows (write parquet) 436 440 9 0.2 4355.8 0.0X +1 cols x 100000 rows (read in-mem) 44 53 6 2.3 440.3 1.0X +1 cols x 100000 rows (exec in-mem) 44 54 9 2.3 437.0 1.0X +1 cols x 100000 rows (read parquet) 53 61 10 1.9 532.4 0.8X +1 cols x 100000 rows (write parquet) 129 142 36 0.8 1291.6 0.3X +100 cols x 1000 rows (read in-mem) 49 55 7 2.0 494.9 0.9X +100 cols x 1000 rows (exec in-mem) 69 73 5 1.4 693.2 0.6X +100 cols x 1000 rows (read parquet) 60 67 8 1.7 596.3 0.7X +100 cols x 1000 rows (write parquet) 142 156 31 0.7 1417.8 0.3X +2500 cols x 40 rows (read in-mem) 391 399 13 0.3 3912.6 0.1X +2500 cols x 40 rows (exec in-mem) 743 749 8 0.1 7432.5 0.1X +2500 cols x 40 rows (read parquet) 297 310 10 0.3 2972.8 0.1X +2500 cols x 40 rows (write parquet) 485 492 16 0.2 4848.1 0.1X ================================================================================================ wide shallowly nested struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 29 31 2 3.4 292.8 1.0X -1 wide x 100000 rows (exec in-mem) 39 40 2 2.6 386.2 0.8X -1 wide x 100000 rows (read parquet) 59 61 4 1.7 593.1 0.5X -1 wide x 100000 rows (write parquet) 103 104 2 1.0 1025.6 0.3X -100 wide x 1000 rows (read in-mem) 41 46 30 2.4 408.3 0.7X -100 wide x 1000 rows (exec in-mem) 71 73 2 1.4 707.6 0.4X -100 wide x 1000 rows (read parquet) 88 91 4 1.1 884.5 0.3X -100 wide x 1000 rows (write parquet) 111 117 18 0.9 1114.7 0.3X -2500 wide x 40 rows (read in-mem) 49 50 2 2.1 485.7 0.6X -2500 wide x 40 rows (exec in-mem) 655 665 7 0.2 6554.9 0.0X -2500 wide x 40 rows (read parquet) 937 947 9 0.1 9365.9 0.0X -2500 wide x 40 rows (write parquet) 121 125 10 0.8 1206.2 0.2X +1 wide x 100000 rows (read in-mem) 43 48 6 2.3 427.0 1.0X +1 wide x 100000 rows (exec in-mem) 56 63 8 1.8 557.8 0.8X +1 wide x 100000 rows (read parquet) 82 88 10 1.2 818.6 0.5X +1 wide x 100000 rows (write parquet) 134 145 21 0.7 1344.6 0.3X +100 wide x 1000 rows (read in-mem) 55 61 16 1.8 553.1 0.8X +100 wide x 1000 rows (exec in-mem) 94 101 17 1.1 941.4 0.5X +100 wide x 1000 rows (read parquet) 151 179 29 0.7 1511.7 0.3X +100 wide x 1000 rows (write parquet) 147 157 9 0.7 1470.0 0.3X +2500 wide x 40 rows (read in-mem) 66 69 9 1.5 658.9 0.6X +2500 wide x 40 rows (exec in-mem) 853 871 30 0.1 8525.7 0.1X +2500 wide x 40 rows (read parquet) 1158 1296 195 0.1 11577.8 0.0X +2500 wide x 40 rows (write parquet) 157 173 23 0.6 1569.6 0.3X ================================================================================================ deeply nested struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 deep x 100000 rows (read in-mem) 27 28 1 3.8 265.3 1.0X -1 deep x 100000 rows (exec in-mem) 32 34 2 3.1 324.3 0.8X -1 deep x 100000 rows (read parquet) 41 42 3 2.5 405.7 0.7X -1 deep x 100000 rows (write parquet) 98 103 17 1.0 975.7 0.3X -100 deep x 1000 rows (read in-mem) 267 268 2 0.4 2672.4 0.1X -100 deep x 1000 rows (exec in-mem) 1012 1013 2 0.1 10121.0 0.0X -100 deep x 1000 rows (read parquet) 950 954 4 0.1 9503.4 0.0X -100 deep x 1000 rows (write parquet) 339 345 9 0.3 3393.0 0.1X -250 deep x 400 rows (read in-mem) 1448 1453 7 0.1 14483.1 0.0X -250 deep x 400 rows (exec in-mem) 6129 6130 1 0.0 61287.0 0.0X -250 deep x 400 rows (read parquet) 5664 5669 7 0.0 56641.1 0.0X -250 deep x 400 rows (write parquet) 1521 1530 13 0.1 15209.0 0.0X +1 deep x 100000 rows (read in-mem) 37 41 6 2.7 374.5 1.0X +1 deep x 100000 rows (exec in-mem) 47 50 6 2.1 466.9 0.8X +1 deep x 100000 rows (read parquet) 58 61 7 1.7 577.7 0.6X +1 deep x 100000 rows (write parquet) 128 134 18 0.8 1282.2 0.3X +100 deep x 1000 rows (read in-mem) 345 350 5 0.3 3447.8 0.1X +100 deep x 1000 rows (exec in-mem) 1283 1283 0 0.1 12830.5 0.0X +100 deep x 1000 rows (read parquet) 1201 1205 7 0.1 12005.2 0.0X +100 deep x 1000 rows (write parquet) 436 443 9 0.2 4361.4 0.1X +250 deep x 400 rows (read in-mem) 1882 1883 1 0.1 18819.9 0.0X +250 deep x 400 rows (exec in-mem) 7705 7709 5 0.0 77054.4 0.0X +250 deep x 400 rows (read parquet) 7052 7087 50 0.0 70517.1 0.0X +250 deep x 400 rows (write parquet) 1978 1979 1 0.1 19780.3 0.0X ================================================================================================ bushy struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 x 1 deep x 100000 rows (read in-mem) 25 26 2 4.1 246.4 1.0X -1 x 1 deep x 100000 rows (exec in-mem) 30 31 2 3.3 303.0 0.8X -1 x 1 deep x 100000 rows (read parquet) 28 29 4 3.5 283.2 0.9X -1 x 1 deep x 100000 rows (write parquet) 96 101 20 1.0 960.5 0.3X -128 x 8 deep x 1000 rows (read in-mem) 28 29 1 3.6 281.5 0.9X -128 x 8 deep x 1000 rows (exec in-mem) 104 105 2 1.0 1040.8 0.2X -128 x 8 deep x 1000 rows (read parquet) 100 102 3 1.0 996.6 0.2X -128 x 8 deep x 1000 rows (write parquet) 99 105 21 1.0 993.9 0.2X -1024 x 11 deep x 100 rows (read in-mem) 48 50 3 2.1 483.3 0.5X -1024 x 11 deep x 100 rows (exec in-mem) 513 517 3 0.2 5132.3 0.0X -1024 x 11 deep x 100 rows (read parquet) 409 412 4 0.2 4086.8 0.1X -1024 x 11 deep x 100 rows (write parquet) 120 124 15 0.8 1198.1 0.2X +1 x 1 deep x 100000 rows (read in-mem) 34 39 7 2.9 341.5 1.0X +1 x 1 deep x 100000 rows (exec in-mem) 42 45 5 2.4 423.4 0.8X +1 x 1 deep x 100000 rows (read parquet) 42 45 6 2.4 423.8 0.8X +1 x 1 deep x 100000 rows (write parquet) 124 132 19 0.8 1240.4 0.3X +128 x 8 deep x 1000 rows (read in-mem) 39 42 6 2.6 387.3 0.9X +128 x 8 deep x 1000 rows (exec in-mem) 134 138 6 0.7 1342.5 0.3X +128 x 8 deep x 1000 rows (read parquet) 147 164 27 0.7 1468.2 0.2X +128 x 8 deep x 1000 rows (write parquet) 130 142 34 0.8 1297.7 0.3X +1024 x 11 deep x 100 rows (read in-mem) 64 68 11 1.6 639.3 0.5X +1024 x 11 deep x 100 rows (exec in-mem) 642 652 14 0.2 6416.9 0.1X +1024 x 11 deep x 100 rows (read parquet) 527 531 5 0.2 5268.1 0.1X +1024 x 11 deep x 100 rows (write parquet) 155 166 28 0.6 1545.0 0.2X ================================================================================================ wide array field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 26 27 2 3.8 261.5 1.0X -1 wide x 100000 rows (exec in-mem) 33 36 3 3.0 331.2 0.8X -1 wide x 100000 rows (read parquet) 52 54 4 1.9 518.7 0.5X -1 wide x 100000 rows (write parquet) 97 103 16 1.0 972.8 0.3X -100 wide x 1000 rows (read in-mem) 22 23 1 4.4 224.8 1.2X -100 wide x 1000 rows (exec in-mem) 28 29 1 3.5 282.7 0.9X -100 wide x 1000 rows (read parquet) 33 34 4 3.0 332.1 0.8X -100 wide x 1000 rows (write parquet) 93 99 21 1.1 932.6 0.3X -2500 wide x 40 rows (read in-mem) 22 24 1 4.5 224.7 1.2X -2500 wide x 40 rows (exec in-mem) 28 29 1 3.6 280.2 0.9X -2500 wide x 40 rows (read parquet) 33 34 4 3.0 328.0 0.8X -2500 wide x 40 rows (write parquet) 93 98 19 1.1 929.0 0.3X +1 wide x 100000 rows (read in-mem) 36 39 5 2.7 364.2 1.0X +1 wide x 100000 rows (exec in-mem) 46 50 7 2.2 460.4 0.8X +1 wide x 100000 rows (read parquet) 75 78 8 1.3 749.8 0.5X +1 wide x 100000 rows (write parquet) 127 133 19 0.8 1266.0 0.3X +100 wide x 1000 rows (read in-mem) 31 33 4 3.2 309.9 1.2X +100 wide x 1000 rows (exec in-mem) 40 42 4 2.5 397.3 0.9X +100 wide x 1000 rows (read parquet) 49 52 7 2.0 488.6 0.7X +100 wide x 1000 rows (write parquet) 122 135 23 0.8 1216.2 0.3X +2500 wide x 40 rows (read in-mem) 31 32 3 3.3 305.7 1.2X +2500 wide x 40 rows (exec in-mem) 39 42 5 2.6 391.9 0.9X +2500 wide x 40 rows (read parquet) 48 51 7 2.1 482.9 0.8X +2500 wide x 40 rows (write parquet) 120 130 22 0.8 1203.6 0.3X ================================================================================================ wide map field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1056-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 22 22 1 4.6 218.4 1.0X -1 wide x 100000 rows (exec in-mem) 30 31 1 3.3 301.7 0.7X -1 wide x 100000 rows (read parquet) 83 85 4 1.2 833.4 0.3X -1 wide x 100000 rows (write parquet) 92 98 19 1.1 918.5 0.2X -100 wide x 1000 rows (read in-mem) 16 17 1 6.2 162.0 1.3X -100 wide x 1000 rows (exec in-mem) 23 23 1 4.4 227.0 1.0X -100 wide x 1000 rows (read parquet) 41 42 4 2.5 407.3 0.5X -100 wide x 1000 rows (write parquet) 86 92 22 1.2 864.1 0.3X -2500 wide x 40 rows (read in-mem) 17 18 1 5.7 174.8 1.2X -2500 wide x 40 rows (exec in-mem) 24 24 1 4.2 237.7 0.9X -2500 wide x 40 rows (read parquet) 41 42 4 2.5 407.8 0.5X -2500 wide x 40 rows (write parquet) 88 93 22 1.1 875.1 0.2X +1 wide x 100000 rows (read in-mem) 35 40 8 2.9 348.8 1.0X +1 wide x 100000 rows (exec in-mem) 46 47 2 2.2 461.8 0.8X +1 wide x 100000 rows (read parquet) 124 127 7 0.8 1236.1 0.3X +1 wide x 100000 rows (write parquet) 125 138 26 0.8 1245.4 0.3X +100 wide x 1000 rows (read in-mem) 26 35 8 3.8 263.1 1.3X +100 wide x 1000 rows (exec in-mem) 35 41 10 2.8 351.8 1.0X +100 wide x 1000 rows (read parquet) 59 62 8 1.7 586.7 0.6X +100 wide x 1000 rows (write parquet) 116 125 32 0.9 1158.2 0.3X +2500 wide x 40 rows (read in-mem) 27 30 5 3.7 270.2 1.3X +2500 wide x 40 rows (exec in-mem) 37 38 3 2.7 366.4 1.0X +2500 wide x 40 rows (read parquet) 58 62 8 1.7 584.3 0.6X +2500 wide x 40 rows (write parquet) 118 126 24 0.9 1176.1 0.3X diff --git a/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt b/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt index 2a7df59f99759..8f3920db0dcd9 100644 --- a/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt @@ -2,16 +2,16 @@ projection on wide table ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -split threshold 10 2942 2975 32 0.4 2805.5 1.0X -split threshold 100 1519 1592 111 0.7 1448.8 1.9X -split threshold 1024 1138 1158 32 0.9 1084.8 2.6X -split threshold 2048 1102 1110 15 1.0 1050.9 2.7X -split threshold 4096 1466 1470 3 0.7 1398.1 2.0X -split threshold 8192 2102 2122 36 0.5 2004.2 1.4X -split threshold 65536 16037 16142 149 0.1 15293.8 0.2X +split threshold 10 8915 9048 180 0.1 8501.7 1.0X +split threshold 100 4419 4465 31 0.2 4214.2 2.0X +split threshold 1024 2477 2559 57 0.4 2362.4 3.6X +split threshold 2048 2314 2391 74 0.5 2206.7 3.9X +split threshold 4096 2374 2399 18 0.4 2264.2 3.8X +split threshold 8192 2831 2846 11 0.4 2699.7 3.1X +split threshold 65536 26886 26944 55 0.0 25640.7 0.3X diff --git a/sql/core/benchmarks/WideTableBenchmark-results.txt b/sql/core/benchmarks/WideTableBenchmark-results.txt index 1fd67fba5caa2..4f64f877ac0c8 100644 --- a/sql/core/benchmarks/WideTableBenchmark-results.txt +++ b/sql/core/benchmarks/WideTableBenchmark-results.txt @@ -2,16 +2,16 @@ projection on wide table ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -split threshold 10 2005 2038 24 0.5 1912.5 1.0X -split threshold 100 1533 1560 40 0.7 1461.6 1.3X -split threshold 1024 1164 1174 10 0.9 1110.1 1.7X -split threshold 2048 1093 1117 50 1.0 1042.6 1.8X -split threshold 4096 1400 1419 17 0.7 1334.8 1.4X -split threshold 8192 1893 2025 286 0.6 1805.0 1.1X -split threshold 65536 16849 17037 375 0.1 16068.8 0.1X +split threshold 10 6461 6535 84 0.2 6161.9 1.0X +split threshold 100 3643 3725 74 0.3 3474.5 1.8X +split threshold 1024 2217 2255 26 0.5 2113.9 2.9X +split threshold 2048 1941 2003 60 0.5 1851.5 3.3X +split threshold 4096 2195 2220 20 0.5 2093.4 2.9X +split threshold 8192 2592 2652 39 0.4 2472.4 2.5X +split threshold 65536 26324 26365 66 0.0 25104.1 0.2X diff --git a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt index 280a93187a305..4a8058766319f 100644 --- a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt +++ b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt @@ -2,44 +2,44 @@ Hive UDAF vs Spark AF ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz hive udaf vs spark af: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hive udaf w/o group by 6136 6543 238 0.0 93627.6 1.0X -spark af w/o group by 35 38 3 1.9 526.9 177.7X -hive udaf w/ group by 4613 4627 12 0.0 70386.0 1.3X -spark af w/ group by w/o fallback 37 39 2 1.8 568.3 164.7X -spark af w/ group by w/ fallback 99 100 2 0.7 1509.6 62.0X +hive udaf w/o group by 6492 7169 388 0.0 99066.1 1.0X +spark af w/o group by 58 88 24 1.1 890.2 111.3X +hive udaf w/ group by 4864 4888 33 0.0 74221.0 1.3X +spark af w/ group by w/o fallback 60 67 7 1.1 912.9 108.5X +spark af w/ group by w/ fallback 154 164 27 0.4 2348.2 42.2X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - typed_count ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 36272 36345 103 2.9 345.9 1.0X -object agg w/ group by w/o fallback 8453 8561 73 12.4 80.6 4.3X -object agg w/ group by w/ fallback 22355 22692 476 4.7 213.2 1.6X -sort agg w/o group by 5450 5490 30 19.2 52.0 6.7X -object agg w/o group by w/o fallback 4714 4725 10 22.2 45.0 7.7X +sort agg w/ group by 51728 51728 0 2.0 493.3 1.0X +object agg w/ group by w/o fallback 10174 10218 34 10.3 97.0 5.1X +object agg w/ group by w/ fallback 29341 29537 277 3.6 279.8 1.8X +sort agg w/o group by 7541 7577 28 13.9 71.9 6.9X +object agg w/o group by w/o fallback 5574 5620 38 18.8 53.2 9.3X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - percentile_approx ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 726 745 10 2.9 346.1 1.0X -object agg w/ group by w/o fallback 551 559 5 3.8 262.8 1.3X -object agg w/ group by w/ fallback 734 744 6 2.9 350.0 1.0X -sort agg w/o group by 490 499 5 4.3 233.8 1.5X -object agg w/o group by w/o fallback 490 498 5 4.3 233.8 1.5X +sort agg w/ group by 900 925 14 2.3 429.0 1.0X +object agg w/ group by w/o fallback 597 633 14 3.5 284.6 1.5X +object agg w/ group by w/ fallback 905 923 10 2.3 431.6 1.0X +sort agg w/o group by 611 631 10 3.4 291.4 1.5X +object agg w/o group by w/o fallback 559 576 11 3.8 266.5 1.6X diff --git a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt index 69ebce09158ab..8c58a5a5fdf0b 100644 --- a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt +++ b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt @@ -2,44 +2,44 @@ Hive UDAF vs Spark AF ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz hive udaf vs spark af: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hive udaf w/o group by 5677 5743 61 0.0 86617.8 1.0X -spark af w/o group by 31 35 4 2.1 478.7 180.9X -hive udaf w/ group by 3965 4003 48 0.0 60495.4 1.4X -spark af w/ group by w/o fallback 34 36 3 1.9 514.3 168.4X -spark af w/ group by w/ fallback 94 96 2 0.7 1431.6 60.5X +hive udaf w/o group by 7014 7206 120 0.0 107031.0 1.0X +spark af w/o group by 47 59 11 1.4 716.9 149.3X +hive udaf w/ group by 4811 4831 28 0.0 73409.1 1.5X +spark af w/ group by w/o fallback 50 56 7 1.3 762.9 140.3X +spark af w/ group by w/ fallback 126 130 8 0.5 1916.6 55.8X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - typed_count ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 34275 34336 86 3.1 326.9 1.0X -object agg w/ group by w/o fallback 7820 8000 253 13.4 74.6 4.4X -object agg w/ group by w/ fallback 20363 20819 434 5.1 194.2 1.7X -sort agg w/o group by 5420 5457 32 19.3 51.7 6.3X -object agg w/o group by w/o fallback 4473 4539 55 23.4 42.7 7.7X +sort agg w/ group by 42969 43306 476 2.4 409.8 1.0X +object agg w/ group by w/o fallback 9744 9844 145 10.8 92.9 4.4X +object agg w/ group by w/ fallback 26814 26960 206 3.9 255.7 1.6X +sort agg w/o group by 6278 6330 57 16.7 59.9 6.8X +object agg w/o group by w/o fallback 5433 5478 60 19.3 51.8 7.9X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - percentile_approx ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 676 695 10 3.1 322.3 1.0X -object agg w/ group by w/o fallback 509 521 5 4.1 242.9 1.3X -object agg w/ group by w/ fallback 685 692 5 3.1 326.4 1.0X -sort agg w/o group by 455 463 4 4.6 216.8 1.5X -object agg w/o group by w/o fallback 456 464 4 4.6 217.4 1.5X +sort agg w/ group by 756 773 9 2.8 360.3 1.0X +object agg w/ group by w/o fallback 548 560 7 3.8 261.3 1.4X +object agg w/ group by w/ fallback 759 773 7 2.8 362.0 1.0X +sort agg w/o group by 471 483 13 4.4 224.8 1.6X +object agg w/o group by w/o fallback 471 482 12 4.5 224.7 1.6X diff --git a/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt b/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt index 8f12d37bce750..d516d3369ad05 100644 --- a/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt +++ b/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt @@ -2,155 +2,155 @@ SQL Single Numeric Column Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1524 1527 3 10.3 96.9 1.0X -Native ORC Vectorized 208 231 28 75.5 13.2 7.3X -Hive built-in ORC 2144 2145 2 7.3 136.3 0.7X +Native ORC MR 1750 1872 173 9.0 111.2 1.0X +Native ORC Vectorized 433 499 68 36.3 27.5 4.0X +Hive built-in ORC 2540 2575 49 6.2 161.5 0.7X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1866 1892 37 8.4 118.6 1.0X -Native ORC Vectorized 195 198 3 80.9 12.4 9.6X -Hive built-in ORC 2347 2373 38 6.7 149.2 0.8X +Native ORC MR 1979 2001 31 7.9 125.8 1.0X +Native ORC Vectorized 261 303 42 60.3 16.6 7.6X +Hive built-in ORC 2559 2583 34 6.1 162.7 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1827 1833 8 8.6 116.2 1.0X -Native ORC Vectorized 234 250 26 67.2 14.9 7.8X -Hive built-in ORC 2440 2461 31 6.4 155.1 0.7X +Native ORC MR 2094 2158 91 7.5 133.2 1.0X +Native ORC Vectorized 309 361 41 50.8 19.7 6.8X +Hive built-in ORC 2649 2744 135 5.9 168.4 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1939 1946 11 8.1 123.3 1.0X -Native ORC Vectorized 342 382 29 46.1 21.7 5.7X -Hive built-in ORC 2558 2586 40 6.1 162.6 0.8X +Native ORC MR 2256 2271 22 7.0 143.4 1.0X +Native ORC Vectorized 511 518 11 30.8 32.5 4.4X +Hive built-in ORC 2867 2880 19 5.5 182.3 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1965 1987 31 8.0 125.0 1.0X -Native ORC Vectorized 432 434 2 36.4 27.5 4.5X -Hive built-in ORC 2613 2642 41 6.0 166.1 0.8X +Native ORC MR 2270 2325 78 6.9 144.3 1.0X +Native ORC Vectorized 502 508 5 31.3 31.9 4.5X +Hive built-in ORC 2862 2880 24 5.5 182.0 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2060 2080 28 7.6 131.0 1.0X -Native ORC Vectorized 508 512 3 31.0 32.3 4.1X -Hive built-in ORC 2773 2803 42 5.7 176.3 0.7X +Native ORC MR 2376 2426 71 6.6 151.0 1.0X +Native ORC Vectorized 609 616 8 25.8 38.7 3.9X +Hive built-in ORC 2979 2991 17 5.3 189.4 0.8X ================================================================================================ Int and String Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3933 3969 50 2.7 375.1 1.0X -Native ORC Vectorized 2119 2119 1 4.9 202.1 1.9X -Hive built-in ORC 4881 4927 65 2.1 465.5 0.8X +Native ORC MR 4112 4232 170 2.6 392.1 1.0X +Native ORC Vectorized 2199 2223 35 4.8 209.7 1.9X +Hive built-in ORC 5150 5238 123 2.0 491.2 0.8X ================================================================================================ Partitioned Table Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - Native ORC MR 2147 2179 45 7.3 136.5 1.0X -Data column - Native ORC Vectorized 385 388 3 40.8 24.5 5.6X -Data column - Hive built-in ORC 2840 2844 6 5.5 180.6 0.8X -Partition column - Native ORC MR 1492 1500 11 10.5 94.9 1.4X -Partition column - Native ORC Vectorized 66 68 3 237.9 4.2 32.5X -Partition column - Hive built-in ORC 1921 1944 33 8.2 122.2 1.1X -Both columns - Native ORC MR 2387 2391 7 6.6 151.7 0.9X -Both columns - Native ORC Vectorized 391 402 18 40.2 24.9 5.5X -Both columns - Hive built-in ORC 2838 2867 41 5.5 180.4 0.8X +Data column - Native ORC MR 2398 2435 53 6.6 152.4 1.0X +Data column - Native ORC Vectorized 458 482 26 34.3 29.1 5.2X +Data column - Hive built-in ORC 3126 3171 64 5.0 198.8 0.8X +Partition column - Native ORC MR 1639 1680 58 9.6 104.2 1.5X +Partition column - Native ORC Vectorized 105 119 11 149.6 6.7 22.8X +Partition column - Hive built-in ORC 2223 2229 8 7.1 141.4 1.1X +Both columns - Native ORC MR 2588 2608 28 6.1 164.5 0.9X +Both columns - Native ORC Vectorized 489 522 49 32.2 31.1 4.9X +Both columns - Hive built-in ORC 3258 3292 48 4.8 207.1 0.7X ================================================================================================ Repeated String Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1847 1854 11 5.7 176.1 1.0X -Native ORC Vectorized 335 347 12 31.3 32.0 5.5X -Hive built-in ORC 2584 2590 8 4.1 246.5 0.7X +Native ORC MR 1991 2028 52 5.3 189.9 1.0X +Native ORC Vectorized 392 398 8 26.7 37.4 5.1X +Hive built-in ORC 2810 2816 8 3.7 268.0 0.7X ================================================================================================ String with Nulls Scan ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3372 3374 3 3.1 321.6 1.0X -Native ORC Vectorized 1049 1053 7 10.0 100.0 3.2X -Hive built-in ORC 4665 4672 10 2.2 444.9 0.7X +Native ORC MR 3638 3647 13 2.9 346.9 1.0X +Native ORC Vectorized 1171 1181 14 9.0 111.7 3.1X +Hive built-in ORC 4847 4871 34 2.2 462.2 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3104 3117 18 3.4 296.0 1.0X -Native ORC Vectorized 1225 1225 0 8.6 116.8 2.5X -Hive built-in ORC 4060 4079 27 2.6 387.2 0.8X +Native ORC MR 3280 3283 5 3.2 312.8 1.0X +Native ORC Vectorized 1199 1206 10 8.7 114.4 2.7X +Hive built-in ORC 4263 4273 14 2.5 406.5 0.8X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1732 1733 1 6.1 165.2 1.0X -Native ORC Vectorized 390 391 0 26.9 37.2 4.4X -Hive built-in ORC 2352 2357 7 4.5 224.3 0.7X +Native ORC MR 1935 1950 21 5.4 184.6 1.0X +Native ORC Vectorized 451 459 10 23.2 43.1 4.3X +Hive built-in ORC 2542 2552 14 4.1 242.4 0.8X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 236 238 2 4.4 225.0 1.0X -Native ORC Vectorized 114 119 5 9.2 109.2 2.1X -Hive built-in ORC 1297 1297 0 0.8 1237.0 0.2X +Native ORC MR 270 292 23 3.9 257.2 1.0X +Native ORC Vectorized 143 155 12 7.3 136.2 1.9X +Hive built-in ORC 1593 1627 48 0.7 1519.1 0.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 312 315 3 3.4 297.4 1.0X -Native ORC Vectorized 194 197 3 5.4 184.9 1.6X -Hive built-in ORC 2340 2358 26 0.4 2231.7 0.1X +Native ORC MR 369 386 17 2.8 351.5 1.0X +Native ORC Vectorized 218 231 15 4.8 208.3 1.7X +Hive built-in ORC 3092 3101 12 0.3 2949.1 0.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 440 442 2 2.4 419.2 1.0X -Native ORC Vectorized 319 320 2 3.3 303.8 1.4X -Hive built-in ORC 3440 3471 43 0.3 3280.6 0.1X +Native ORC MR 498 531 33 2.1 475.0 1.0X +Native ORC Vectorized 360 376 18 2.9 342.9 1.4X +Hive built-in ORC 4786 4786 1 0.2 4564.1 0.1X diff --git a/sql/hive/benchmarks/OrcReadBenchmark-results.txt b/sql/hive/benchmarks/OrcReadBenchmark-results.txt index 99046cf20b0c5..c7d6c976192b2 100644 --- a/sql/hive/benchmarks/OrcReadBenchmark-results.txt +++ b/sql/hive/benchmarks/OrcReadBenchmark-results.txt @@ -2,155 +2,155 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1375 1376 1 11.4 87.4 1.0X -Native ORC Vectorized 188 197 10 83.8 11.9 7.3X -Hive built-in ORC 1766 1767 1 8.9 112.3 0.8X +Native ORC MR 1844 1851 10 8.5 117.2 1.0X +Native ORC Vectorized 284 312 36 55.5 18.0 6.5X +Hive built-in ORC 2380 2380 1 6.6 151.3 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1564 1575 16 10.1 99.4 1.0X -Native ORC Vectorized 191 193 3 82.4 12.1 8.2X -Hive built-in ORC 1994 2013 28 7.9 126.8 0.8X +Native ORC MR 1999 2031 45 7.9 127.1 1.0X +Native ORC Vectorized 252 264 15 62.5 16.0 7.9X +Hive built-in ORC 2483 2509 37 6.3 157.9 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1600 1601 0 9.8 101.8 1.0X -Native ORC Vectorized 236 239 3 66.6 15.0 6.8X -Hive built-in ORC 2123 2124 2 7.4 135.0 0.8X +Native ORC MR 2134 2135 2 7.4 135.7 1.0X +Native ORC Vectorized 329 351 34 47.8 20.9 6.5X +Hive built-in ORC 2672 2716 61 5.9 169.9 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1632 1648 22 9.6 103.8 1.0X -Native ORC Vectorized 298 301 3 52.8 18.9 5.5X -Hive built-in ORC 2216 2221 7 7.1 140.9 0.7X +Native ORC MR 2172 2247 105 7.2 138.1 1.0X +Native ORC Vectorized 407 427 23 38.7 25.9 5.3X +Hive built-in ORC 2806 2822 22 5.6 178.4 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1681 1706 36 9.4 106.9 1.0X -Native ORC Vectorized 347 351 4 45.3 22.1 4.8X -Hive built-in ORC 2186 2215 42 7.2 139.0 0.8X +Native ORC MR 2187 2200 19 7.2 139.0 1.0X +Native ORC Vectorized 451 457 5 34.9 28.7 4.8X +Hive built-in ORC 2886 2938 73 5.4 183.5 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1764 1771 9 8.9 112.2 1.0X -Native ORC Vectorized 422 426 5 37.3 26.8 4.2X -Hive built-in ORC 2266 2286 28 6.9 144.1 0.8X +Native ORC MR 2313 2319 9 6.8 147.1 1.0X +Native ORC Vectorized 554 562 7 28.4 35.2 4.2X +Hive built-in ORC 2927 2933 8 5.4 186.1 0.8X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3390 3483 131 3.1 323.3 1.0X -Native ORC Vectorized 1854 1865 15 5.7 176.8 1.8X -Hive built-in ORC 4083 4143 86 2.6 389.4 0.8X +Native ORC MR 4162 4294 186 2.5 397.0 1.0X +Native ORC Vectorized 2236 2258 32 4.7 213.2 1.9X +Hive built-in ORC 5054 5135 114 2.1 482.0 0.8X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - Native ORC MR 1898 1911 18 8.3 120.7 1.0X -Data column - Native ORC Vectorized 307 309 3 51.3 19.5 6.2X -Data column - Hive built-in ORC 2349 2363 20 6.7 149.4 0.8X -Partition column - Native ORC MR 1268 1269 1 12.4 80.6 1.5X -Partition column - Native ORC Vectorized 61 64 7 258.2 3.9 31.2X -Partition column - Hive built-in ORC 1691 1730 56 9.3 107.5 1.1X -Both columns - Native ORC MR 2070 2074 6 7.6 131.6 0.9X -Both columns - Native ORC Vectorized 345 348 2 45.6 21.9 5.5X -Both columns - Hive built-in ORC 2439 2440 2 6.4 155.1 0.8X +Data column - Native ORC MR 2436 2447 16 6.5 154.8 1.0X +Data column - Native ORC Vectorized 421 443 35 37.4 26.8 5.8X +Data column - Hive built-in ORC 3007 3026 27 5.2 191.2 0.8X +Partition column - Native ORC MR 1603 1630 39 9.8 101.9 1.5X +Partition column - Native ORC Vectorized 84 96 15 186.7 5.4 28.9X +Partition column - Hive built-in ORC 2174 2187 18 7.2 138.2 1.1X +Both columns - Native ORC MR 2609 2645 51 6.0 165.9 0.9X +Both columns - Native ORC Vectorized 460 470 9 34.2 29.3 5.3X +Both columns - Hive built-in ORC 3094 3099 8 5.1 196.7 0.8X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1629 1630 1 6.4 155.3 1.0X -Native ORC Vectorized 297 306 11 35.2 28.4 5.5X -Hive built-in ORC 2152 2168 22 4.9 205.3 0.8X +Native ORC MR 2036 2046 13 5.1 194.2 1.0X +Native ORC Vectorized 366 386 18 28.6 34.9 5.6X +Hive built-in ORC 2683 2686 4 3.9 255.9 0.8X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2896 2906 14 3.6 276.2 1.0X -Native ORC Vectorized 893 897 3 11.7 85.1 3.2X -Hive built-in ORC 3762 3769 9 2.8 358.8 0.8X +Native ORC MR 3614 3643 40 2.9 344.7 1.0X +Native ORC Vectorized 1072 1087 22 9.8 102.2 3.4X +Hive built-in ORC 4625 4636 15 2.3 441.1 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2889 2930 59 3.6 275.5 1.0X -Native ORC Vectorized 1176 1178 3 8.9 112.1 2.5X -Hive built-in ORC 3564 3607 61 2.9 339.9 0.8X +Native ORC MR 3347 3376 42 3.1 319.2 1.0X +Native ORC Vectorized 1220 1225 7 8.6 116.3 2.7X +Hive built-in ORC 4168 4184 23 2.5 397.5 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1541 1550 14 6.8 146.9 1.0X -Native ORC Vectorized 400 401 1 26.2 38.2 3.9X -Hive built-in ORC 2037 2049 17 5.1 194.3 0.8X +Native ORC MR 1851 1862 16 5.7 176.5 1.0X +Native ORC Vectorized 466 471 7 22.5 44.4 4.0X +Hive built-in ORC 2523 2529 8 4.2 240.6 0.7X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 205 209 5 5.1 195.6 1.0X -Native ORC Vectorized 104 109 5 10.1 99.5 2.0X -Hive built-in ORC 1441 1443 3 0.7 1373.9 0.1X +Native ORC MR 250 264 15 4.2 238.1 1.0X +Native ORC Vectorized 121 138 24 8.7 115.5 2.1X +Hive built-in ORC 1761 1792 43 0.6 1679.3 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 275 278 3 3.8 262.5 1.0X -Native ORC Vectorized 173 175 3 6.1 164.5 1.6X -Hive built-in ORC 2658 2660 4 0.4 2534.5 0.1X +Native ORC MR 319 341 17 3.3 304.5 1.0X +Native ORC Vectorized 188 222 50 5.6 178.8 1.7X +Hive built-in ORC 3492 3508 24 0.3 3329.8 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1051-aws -Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws +Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 388 391 3 2.7 370.0 1.0X -Native ORC Vectorized 283 288 10 3.7 269.5 1.4X -Hive built-in ORC 3899 3902 4 0.3 3718.4 0.1X +Native ORC MR 443 456 12 2.4 422.9 1.0X +Native ORC Vectorized 306 321 23 3.4 292.0 1.4X +Hive built-in ORC 5295 5312 24 0.2 5049.9 0.1X