Skip to content

Latest commit

 

History

History
462 lines (439 loc) · 30.9 KB

report.md

File metadata and controls

462 lines (439 loc) · 30.9 KB

Benchmark Report

Job Properties

Commits: JuliaLang/julia@bae2d8db1f25a252e8a82ff8493b59ce3f245743 vs JuliaLang/julia@3bf9d1773144bc4943232dc2ffaac307a700853d

Comparison Diff: link

Triggered By: link

Tag Predicate: ALL

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["array", "accumulate", ("cumsum!", "Int")] 1.67 (5%) ❌ 1.00 (1%)
["array", "accumulate", ("cumsum", "Int")] 1.37 (5%) ❌ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float32}")] 0.78 (5%) ✅ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float64} generator")] 1.27 (5%) ❌ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float32} generator")] 0.77 (5%) ✅ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float32}")] 0.77 (5%) ✅ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float64} generator")] 0.79 (5%) ✅ 1.00 (1%)
["array", "any/all", ("any", "Vector{Float64}")] 1.28 (5%) ❌ 1.00 (1%)
["array", "bool", "boolarray_true_fill!"] 0.89 (5%) ✅ 1.00 (1%)
["array", "cat", "4467"] 1.15 (5%) ❌ 1.00 (1%)
["array", "cat", ("catnd_setind", 5)] 1.19 (5%) ❌ 1.00 (1%)
["array", "cat", ("hvcat_setind", 5)] 0.94 (5%) ✅ 1.00 (1%)
["array", "equality", ("==", "BitArray")] 1.26 (5%) ❌ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Float64}")] 1.17 (5%) ❌ 1.00 (1%)
["array", "growth", ("append!", 8)] 1.20 (5%) ❌ 1.00 (1%)
["array", "growth", ("prerend!", 8)] 1.16 (5%) ❌ 1.00 (1%)
["array", "growth", ("push_multiple!", 2048)] 1.72 (5%) ❌ 1.00 (1%)
["array", "growth", ("push_multiple!", 256)] 1.70 (5%) ❌ 1.00 (1%)
["array", "growth", ("push_multiple!", 8)] 1.66 (5%) ❌ 1.00 (1%)
["array", "growth", ("push_single!", 2048)] 1.41 (5%) ❌ 1.00 (1%)
["array", "growth", ("push_single!", 256)] 1.55 (5%) ❌ 1.00 (1%)
["array", "growth", ("push_single!", 8)] 1.46 (5%) ❌ 1.00 (1%)
["array", "index", ("sumelt", "SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] 1.97 (50%) ❌ 1.00 (1%)
["array", "index", ("sumelt_boundscheck", "100000:-1:1")] 2.00 (50%) ❌ 1.00 (1%)
["array", "index", ("sumvector_view", "BitMatrix")] 1.95 (50%) ❌ 1.00 (1%)
["array", "index", ("sumvector_view", "SubArray{Float32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] 1.51 (50%) ❌ 1.00 (1%)
["array", "reverse", "rev_load_fast!"] 0.90 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (10, "scal_tup")] 1.28 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (10, "scal_tup_x3")] 0.94 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "tup_tup")] 0.83 (5%) ✅ 1.00 (1%)
["broadcast", "sparse", ("(1000, 1000)", 1)] 1.09 (5%) ❌ 1.00 (1%)
["collection", "deletion", ("IdDict", "Any", "filter!")] 1.43 (25%) ❌ 1.00 (1%)
["collection", "deletion", ("IdDict", "Int", "filter!")] 1.77 (25%) ❌ 1.00 (1%)
["collection", "deletion", ("Set", "Int", "filter!")] 1.45 (25%) ❌ 1.00 (1%)
["collection", "deletion", ("Vector", "Any", "pop!")] 1.75 (25%) ❌ 1.00 (1%)
["collection", "deletion", ("Vector", "Int", "pop!")] 1.49 (25%) ❌ 1.00 (1%)
["collection", "deletion", ("Vector", "String", "pop!")] 1.65 (25%) ❌ 1.00 (1%)
["collection", "initialization", ("Vector", "Any", "loop")] 1.45 (25%) ❌ 1.00 (1%)
["collection", "initialization", ("Vector", "Any", "loop", "sizehint!")] 1.48 (25%) ❌ 1.00 (1%)
["collection", "initialization", ("Vector", "Int", "loop")] 1.76 (25%) ❌ 1.00 (1%)
["collection", "initialization", ("Vector", "Int", "loop", "sizehint!")] 1.94 (25%) ❌ 1.00 (1%)
["collection", "initialization", ("Vector", "String", "loop")] 1.46 (25%) ❌ 1.00 (1%)
["collection", "initialization", ("Vector", "String", "loop", "sizehint!")] 1.52 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Dict", "Any", "iterate second")] 1.75 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Dict", "Any", "iterate")] 1.51 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Dict", "String", "iterate second")] 1.57 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Dict", "String", "iterate")] 1.51 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("IdDict", "Any", "iterate second")] 2.08 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("IdDict", "Any", "iterate")] 2.15 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("IdDict", "Int", "iterate second")] 2.08 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("IdDict", "Int", "iterate")] 1.81 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("IdDict", "String", "iterate second")] 1.94 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("IdDict", "String", "iterate")] 1.91 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Set", "String", "iterate second")] 1.76 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Set", "String", "iterate")] 1.76 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Vector", "String", "iterate second")] 1.88 (25%) ❌ 1.00 (1%)
["collection", "iteration", ("Vector", "String", "iterate")] 1.75 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("Dict", "abstract", "Nothing")] 1.85 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("Dict", "concrete", "Nothing")] 1.81 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("IdDict", "abstract", "Bool")] 1.30 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("IdDict", "abstract", "Nothing")] 1.27 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("IdDict", "concrete", "Bool")] 1.30 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("IdDict", "concrete", "Nothing")] 1.27 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("Set", "abstract", "Nothing")] 1.34 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("Set", "concrete", "Nothing")] 1.48 (25%) ❌ 1.00 (1%)
["collection", "optimizations", ("Vector", "abstract", "Nothing")] 1.34 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Dict", "Any", "in", "true")] 1.26 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "Any", "getindex")] 1.29 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "Any", "in", "false")] 1.34 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "Any", "in", "true")] 1.37 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "Int", "first")] 2.32 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "Int", "getindex")] 1.32 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "Int", "in", "false")] 1.27 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "Int", "in", "true")] 1.37 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "String", "getindex")] 1.28 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "String", "in", "false")] 1.34 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("IdDict", "String", "in", "true")] 1.32 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Any", "in", "false")] 1.27 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Any", "in", "true")] 1.27 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Any", "pop!", "unspecified")] 1.64 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Any", "push!")] 1.44 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Any", "setindex!")] 1.37 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Int", "pop!", "unspecified")] 1.72 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Int", "push!")] 1.57 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "String", "pop!", "unspecified")] 1.70 (25%) ❌ 1.00 (1%)
["collection", "queries & updates", ("Vector", "String", "push!")] 1.37 (25%) ❌ 1.00 (1%)
["collection", "set operations", ("BitSet", "Int", "==", "self")] 1.25 (25%) ❌ 1.00 (1%)
["collection", "set operations", ("BitSet", "Int", "intersect!", "big")] 1.62 (25%) ❌ 1.00 (1%)
["dates", "accessor", "hour"] 1.07 (5%) ❌ 1.00 (1%)
["dates", "accessor", "minute"] 0.91 (5%) ✅ 1.00 (1%)
["dates", "accessor", "second"] 1.09 (5%) ❌ 1.00 (1%)
["dates", "conversion", "DateTime -> Date"] 1.16 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Float64}")] 1.09 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{UInt8}")] 0.91 (5%) ✅ 1.00 (1%)
["find", "findall", ("BitVector", "50-50")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "10-90")] 0.95 (5%) ✅ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "50-50")] 0.90 (5%) ✅ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "90-10")] 0.78 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float32}")] 1.07 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float64}")] 1.07 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{UInt64}")] 1.05 (5%) ❌ 1.00 (1%)
["find", "findprev", ("Vector{Bool}", "50-50")] 0.93 (5%) ✅ 1.00 (1%)
["io", "read", "read"] 1.33 (5%) ❌ 1.00 (1%)
["linalg", "arithmetic", ("cumsum!", "Int64", 1024)] 1.58 (45%) ❌ 1.00 (1%)
["misc", "23042", "Float32"] 1.27 (5%) ❌ 1.00 (1%)
["misc", "iterators", "zip(1:1)"] 1.21 (5%) ❌ 1.00 (1%)
["misc", "iterators", "zip(1:1, 1:1)"] 1.19 (5%) ❌ 1.00 (1%)
["misc", "iterators", "zip(1:1, 1:1, 1:1)"] 1.17 (5%) ❌ 1.00 (1%)
["misc", "iterators", "zip(1:1, 1:1, 1:1, 1:1)"] 1.16 (5%) ❌ 1.00 (1%)
["misc", "parse", "Float64"] 1.23 (5%) ❌ 1.00 (1%)
["misc", "parse", "Int"] 1.10 (5%) ❌ 1.00 (1%)
["misc", "splatting", (3, 3, 3)] 1.17 (5%) ❌ 1.00 (1%)
["problem", "go", "go_game"] 1.06 (5%) ❌ 1.00 (1%)
["problem", "imdb", "centrality"] 1.12 (5%) ❌ 1.00 (1%)
["problem", "json", "parse_json"] 1.20 (5%) ❌ 1.00 (1%)
["problem", "laplacian", "laplace_iter_vec"] 1.22 (5%) ❌ 1.00 (1%)
["problem", "monte carlo", "euro_option_vec"] 0.90 (5%) ✅ 1.00 (1%)
["problem", "simplex", "simplex"] 0.76 (5%) ✅ 1.00 (1%)
["problem", "spellcheck", "spellcheck"] 1.10 (5%) ❌ 1.00 (1%)
["random", "randstring", ("randstring", "MersenneTwister")] 1.27 (25%) ❌ 1.00 (1%)
["random", "randstring", ("randstring", "MersenneTwister", "collect(UInt8, \"qwerty\"")] 1.26 (25%) ❌ 1.00 (1%)
["random", "sequences", ("randsubseq!", "MersenneTwister", "0.8")] 1.58 (25%) ❌ 1.00 (1%)
["scalar", "acos", ("0.5 <= abs(x) < 1", "negative argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("small", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("0.975 <= abs(x) < 1.0", "negative argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "negative argument", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("0 <= abs(x) < 7/16", "negative argument", "Float64")] 1.10 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("0 <= abs(x) < 7/16", "positive argument", "Float64")] 1.10 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "negative argument", "Float64")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "positive argument", "Float64")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "negative argument", "Float64")] 1.10 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "positive argument", "Float64")] 1.13 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very large", "negative argument", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very large", "positive argument", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very small", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("zero", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y negative", "x positive", "Float64")] 1.14 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y positive", "x positive", "Float64")] 1.13 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x negative", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("x one", "Float32")] 1.25 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("x one", "Float64")] 0.72 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("x zero", "y negative", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("x zero", "y positive", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y finite", "y negative", "x infinite", "x negative", "Float64")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y finite", "y negative", "x infinite", "x positive", "Float64")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y finite", "y positive", "x infinite", "x negative", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y infinite", "y negative", "x finite", "x negative", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("y infinite", "y negative", "x infinite", "x negative", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y infinite", "y negative", "x infinite", "x positive", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y infinite", "y positive", "x infinite", "x negative", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y zero", "y negative", "x positive", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y zero", "y positive", "x negative", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("y zero", "y positive", "x positive", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("one", "Float64")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("very large", "positive argument", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "cosh", ("very small", "positive argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "cosh", ("zero", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "exp2", ("2pow1023", "negative argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "exp2", ("2pow1023", "positive argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "expm1", ("small", "negative argument", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "rem_pio2", ("argument reduction (hard) abs(x) < 4π/4", "positive argument", "Float64")] 1.21 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("no reduction", "negative argument", "Float32", "sin_kernel")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("2.0^-28 <= abs(x) < 22.0", "positive argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("large", "negative argument", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("large", "negative argument", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("medium", "negative argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "tanh", ("1f0 <= abs(x) < 9f0", "negative argument", "Float32")] 1.14 (5%) ❌ 1.00 (1%)
["shootout", "fannkuch"] 0.89 (5%) ✅ 1.00 (1%)
["shootout", "fasta"] 0.91 (5%) ✅ 1.00 (1%)
["simd", ("Cartesian", "axpy!", "Float64", 2, 64)] 1.32 (20%) ❌ 1.00 (1%)
["simd", ("Cartesian", "conditional_loop!", "Int32", 3, 32)] 1.22 (20%) ❌ 1.00 (1%)
["simd", ("Cartesian", "inner", "Int32", 2, 31)] 2.06 (20%) ❌ 1.00 (1%)
["simd", ("Cartesian", "inner", "Int32", 2, 63)] 1.53 (20%) ❌ 1.00 (1%)
["simd", ("CartesianPartition", "axpy!", "Float64", 2, 31)] 0.75 (20%) ✅ 1.00 (1%)
["simd", ("CartesianPartition", "axpy!", "Int32", 4, 31)] 1.44 (20%) ❌ 1.00 (1%)
["simd", ("CartesianPartition", "conditional_loop!", "Int32", 3, 32)] 1.27 (20%) ❌ 1.00 (1%)
["simd", ("CartesianPartition", "conditional_loop!", "Int32", 3, 64)] 1.20 (20%) ❌ 1.00 (1%)
["simd", ("CartesianPartition", "inner", "Int32", 2, 31)] 1.29 (20%) ❌ 1.00 (1%)
["simd", ("CartesianPartition", "manual_example!", "Float64", 2, 31)] 1.45 (20%) ❌ 1.00 (1%)
["simd", ("Linear", "auto_axpy!", "Float64", 4095)] 1.26 (20%) ❌ 1.00 (1%)
["simd", ("Linear", "axpy!", "Float64", 4095)] 1.27 (20%) ❌ 1.00 (1%)
["sparse", "constructors", ("Bidiagonal", 1000)] 1.13 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("Diagonal", 100)] 1.07 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("Diagonal", 1000)] 1.13 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("IJV", 100)] 1.07 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("IJV", 1000)] 1.06 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("SymTridiagonal", 1000)] 1.10 (5%) ❌ 1.00 (1%)
["sparse", "sparse solves", "square system (ldlt), matrix rhs"] 1.05 (5%) ❌ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "different length"] 0.72 (5%) ✅ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "equal"] 0.72 (5%) ✅ 1.00 (1%)
["string", "==(::SubString, ::String)", "different"] 1.18 (5%) ❌ 1.00 (1%)
["string", "findfirst", "Char"] 0.94 (5%) ✅ 1.00 (1%)
["string", "readuntil", "backtracking"] 0.94 (5%) ✅ 1.00 (1%)
["string", "readuntil", "target length 1000"] 1.32 (5%) ❌ 1.00 (1%)
["string", "readuntil", "target length 50000"] 1.33 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(8, 8)", "(8,)")] 0.94 (5%) ✅ 1.00 (1%)
["tuple", "misc", "11899"] 1.19 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("minimum", "(2,)")] 0.93 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("minimum", "(4,)")] 0.94 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sum", "(16,)")] 0.93 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sum", "(2,)")] 0.93 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sum", "(8,)")] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "abs", "ComplexF64", 0)] 1.15 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "filter", "BigInt", 0)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "BigInt", 1)] 0.53 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Bool", 0)] 0.87 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Bool", 1)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "ComplexF64", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float32", 0)] 0.87 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float32", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float64", 0)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float64", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int64", 0)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int64", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int8", 0)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int8", 1)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "BigFloat", 0)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "BigInt", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Float32", 0)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Float64", 0)] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Int8", 0)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, Bool}", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, ComplexF64}", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, Float32}", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, Float64}", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, Int8}", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, BigFloat}", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, BigInt}", 0)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Bool}", 0)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Float32}", 0)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Float64}", 0)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Int64}", 0)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Int8}", 0)] 0.89 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["array", "accumulate"]
  • ["array", "any/all"]
  • ["array", "bool"]
  • ["array", "cat"]
  • ["array", "comprehension"]
  • ["array", "convert"]
  • ["array", "equality"]
  • ["array", "growth"]
  • ["array", "index"]
  • ["array", "reductions"]
  • ["array", "reverse"]
  • ["array", "setindex!"]
  • ["array", "subarray"]
  • ["broadcast"]
  • ["broadcast", "dotop"]
  • ["broadcast", "fusion"]
  • ["broadcast", "mix_scalar_tuple"]
  • ["broadcast", "sparse"]
  • ["broadcast", "typeargs"]
  • ["collection", "deletion"]
  • ["collection", "initialization"]
  • ["collection", "iteration"]
  • ["collection", "optimizations"]
  • ["collection", "queries & updates"]
  • ["collection", "set operations"]
  • ["dates", "accessor"]
  • ["dates", "arithmetic"]
  • ["dates", "construction"]
  • ["dates", "conversion"]
  • ["dates", "parse"]
  • ["dates", "query"]
  • ["dates", "string"]
  • ["find", "findall"]
  • ["find", "findnext"]
  • ["find", "findprev"]
  • ["frontend"]
  • ["io", "array_limit"]
  • ["io", "read"]
  • ["io", "serialization"]
  • ["io"]
  • ["linalg", "arithmetic"]
  • ["linalg", "blas"]
  • ["linalg", "factorization"]
  • ["linalg"]
  • ["micro"]
  • ["misc"]
  • ["misc", "23042"]
  • ["misc", "afoldl"]
  • ["misc", "allocation elision view"]
  • ["misc", "bitshift"]
  • ["misc", "foldl"]
  • ["misc", "issue 12165"]
  • ["misc", "iterators"]
  • ["misc", "julia"]
  • ["misc", "parse"]
  • ["misc", "repeat"]
  • ["misc", "splatting"]
  • ["problem", "chaosgame"]
  • ["problem", "fem"]
  • ["problem", "go"]
  • ["problem", "grigoriadis khachiyan"]
  • ["problem", "imdb"]
  • ["problem", "json"]
  • ["problem", "laplacian"]
  • ["problem", "monte carlo"]
  • ["problem", "raytrace"]
  • ["problem", "seismic"]
  • ["problem", "simplex"]
  • ["problem", "spellcheck"]
  • ["problem", "stockcorr"]
  • ["problem", "ziggurat"]
  • ["random", "collections"]
  • ["random", "randstring"]
  • ["random", "ranges"]
  • ["random", "sequences"]
  • ["random", "types"]
  • ["scalar", "acos"]
  • ["scalar", "acosh"]
  • ["scalar", "arithmetic"]
  • ["scalar", "asin"]
  • ["scalar", "asinh"]
  • ["scalar", "atan"]
  • ["scalar", "atan2"]
  • ["scalar", "atanh"]
  • ["scalar", "cbrt"]
  • ["scalar", "cos"]
  • ["scalar", "cosh"]
  • ["scalar", "exp2"]
  • ["scalar", "expm1"]
  • ["scalar", "fastmath"]
  • ["scalar", "floatexp"]
  • ["scalar", "intfuncs"]
  • ["scalar", "iteration"]
  • ["scalar", "mod2pi"]
  • ["scalar", "predicate"]
  • ["scalar", "rem_pio2"]
  • ["scalar", "sin"]
  • ["scalar", "sincos"]
  • ["scalar", "sinh"]
  • ["scalar", "tan"]
  • ["scalar", "tanh"]
  • ["shootout"]
  • ["simd"]
  • ["sort", "insertionsort"]
  • ["sort", "issorted"]
  • ["sort", "mergesort"]
  • ["sort", "quicksort"]
  • ["sparse", "arithmetic"]
  • ["sparse", "constructors"]
  • ["sparse", "index"]
  • ["sparse", "matmul"]
  • ["sparse", "sparse matvec"]
  • ["sparse", "sparse solves"]
  • ["sparse", "transpose"]
  • ["string", "==(::AbstractString, ::AbstractString)"]
  • ["string", "==(::SubString, ::String)"]
  • ["string", "findfirst"]
  • ["string"]
  • ["string", "readuntil"]
  • ["string", "repeat"]
  • ["tuple", "index"]
  • ["tuple", "linear algebra"]
  • ["tuple", "misc"]
  • ["tuple", "reduction"]
  • ["union", "array"]

Version Info

Primary Build

Julia Version 1.7.1
Commit bae2d8db1f (2021-12-19 13:34 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.3 LTS
  uname: Linux 5.11.0-1022-aws #23~20.04.1-Ubuntu SMP Mon Nov 15 14:03:19 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  2999 MHz      15062 s         44 s       3451 s     593876 s          0 s
       #2  3402 MHz     488447 s          0 s      26017 s      98145 s          0 s
       #3  2999 MHz      12873 s          7 s        691 s     599183 s          0 s
       #4  2999 MHz       7450 s          7 s        702 s     604109 s          0 s
       #5  2999 MHz      14638 s          0 s        766 s     597550 s          0 s
       #6  2999 MHz       6630 s          0 s        652 s     605693 s          0 s
       #7  2999 MHz       7015 s          0 s        684 s     605220 s          0 s
       #8  2999 MHz       8452 s         14 s        680 s     603093 s          0 s
       
  Memory: 30.353321075439453 GB (8654.08203125 MB free)
  Uptime: 61307.22 sec
  Load Avg:  1.01  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Comparison Build

Julia Version 1.7.0
Commit 3bf9d17731 (2021-11-30 12:12 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.3 LTS
  uname: Linux 5.11.0-1022-aws #23~20.04.1-Ubuntu SMP Mon Nov 15 14:03:19 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  2999 MHz      16130 s         44 s       3918 s     718546 s          0 s
       #2  3402 MHz     606712 s          0 s      32104 s     100055 s          0 s
       #3  2999 MHz      12909 s          7 s        705 s     725395 s          0 s
       #4  2999 MHz       7878 s          7 s        717 s     729910 s          0 s
       #5  2999 MHz      15268 s          0 s        798 s     723152 s          0 s
       #6  2999 MHz       6670 s          0 s        663 s     731904 s          0 s
       #7  2999 MHz       7056 s          0 s        699 s     731427 s          0 s
       #8  2999 MHz       8529 s         14 s        693 s     729265 s          0 s
       
  Memory: 30.353321075439453 GB (9887.6015625 MB free)
  Uptime: 73933.62 sec
  Load Avg:  1.02  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)