Skip to content

Latest commit

 

History

History
164 lines (141 loc) · 6.58 KB

b1b3d36_vs_b0e098a.md

File metadata and controls

164 lines (141 loc) · 6.58 KB
Raw

Benchmark Report

Job Properties

Commit(s): JuliaLang/julia@b1b3d36ec8afd10ea9cdadac849596f0b972819c vs JuliaLang/julia@b0e098aab77335c0b100c4515e5d63d07ac69c9a

Tag Predicate: ALL

Triggered By: link

Results

Below is a table of this job's results. If available, the data used to generate this table can be found in the JLD file in this directory.

Benchmark definitions can be found in JuliaCI/BaseBenchmarks.jl.

The ratio values in the below table equal primary_result / comparison_result for each corresponding metric. Thus, x < 1.0 would denote an improvement, while x > 1.0 would denote a regression. Note that a default tolerance of 0.20 is applied to account for the variance of our test hardware.

Regressions are marked with ❌, while improvements are marked with ✅. GC measurements are not considered when determining regression status.

Only benchmarks with significant results - results that indicate regressions or improvements - are shown below (an empty table means that all benchmark results remained invariant between builds).

Group ID Benchmark ID time GC time memory allocated number of allocations
"blas" ("gbmv",1024) 0.73 ✅ 1.01 1.00 1.00
"blas" ("gbmv!",1024) 0.58 ✅ 1.00 1.00 1.00
"scalar arithmetic" ("scalar_mul","Complex{Float64}","Complex{Float32}") 0.77 ✅ 1.00 1.00 1.00
"simd" ("sum_reduce","Float64",256) 1.26 ❌ 1.00 1.00 1.00
"simd" ("sum_reduce","Int64",1000) 0.77 ✅ 1.00 1.00 1.00
"sort insertionsort" ("sort reverse","insertionsort","random") 1.00 1.00 0.99 0.23 ✅
"sort mergesort" ("sort reverse","mergesort","random") 1.00 2.02 1.00 0.64 ✅
"sort sortperm insertionsort" ("sortperm reverse","insertionsort","ascending") 1.00 1.00 0.99 0.10 ✅
"sort sortperm insertionsort" ("sortperm!","insertionsort","descending") 1.00 1.00 0.92 0.01 ✅

Version Info

Primary Build

Julia Version 0.5.0-dev+3636
Commit b1b3d36 (2016-04-19 16:20 UTC)
Platform Info:
  System: Linux (x86_64-linux-gnu)
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz
  WORD_SIZE: 64
           Ubuntu 14.04.4 LTS
  uname: Linux 3.13.0-65-generic #105-Ubuntu SMP Mon Sep 21 18:50:58 UTC 2015 x86_64 x86_64
Memory: 31.383678436279297 GB (22625.2265625 MB free)
Uptime: 1.7482301e7 sec
Load Avg:  1.0029296875  1.0146484375  1.04541015625
Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
       speed         user         nice          sys         idle          irq
#1  3501 MHz    9891019 s       3144 s    7461944 s  1724404373 s         18 s
#2  3501 MHz   14327146 s        245 s    3743736 s  1728348350 s          3 s
#3  3501 MHz   10705931 s       1347 s    3865775 s  1732283937 s          2 s
#4  3501 MHz   10027226 s        303 s    3630928 s  1733444240 s          2 s
#5  3501 MHz   11469320 s       4215 s    3419304 s  1732897469 s          0 s
#6  3501 MHz    7033343 s       1198 s    3128219 s  1737690562 s          0 s
#7  3501 MHz    8742255 s       2155 s    3365512 s  1735696814 s          0 s
#8  3501 MHz    6702555 s       1400 s    3312904 s  1737874192 s          0 s

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas64_
  LIBM: libopenlibm
  LLVM: libLLVM-3.7.1 (ORCJIT, haswell)

Comparison Build

Julia Version 0.5.0-dev+3630
Commit b0e098a (2016-04-19 15:51 UTC)
Platform Info:
  System: Linux (x86_64-linux-gnu)
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz
  WORD_SIZE: 64
           Ubuntu 14.04.4 LTS
  uname: Linux 3.13.0-65-generic #105-Ubuntu SMP Mon Sep 21 18:50:58 UTC 2015 x86_64 x86_64
Memory: 31.383678436279297 GB (22595.75 MB free)
Uptime: 1.7507848e7 sec
Load Avg:  1.0029296875  1.0146484375  1.04541015625
Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
       speed         user         nice          sys         idle          irq
#1  3501 MHz    9892170 s       3144 s    7471597 s  1726935231 s         19 s
#2  3501 MHz   14771940 s        245 s    3754454 s  1730423305 s          4 s
#3  3501 MHz   11685209 s       1347 s    3873943 s  1733828917 s          2 s
#4  3501 MHz   10112237 s        303 s    3638602 s  1735889783 s          2 s
#5  3501 MHz   12330753 s       4215 s    3437730 s  1734556596 s          0 s
#6  3501 MHz    7083683 s       1198 s    3136015 s  1740175775 s          0 s
#7  3501 MHz    9014436 s       2155 s    3375088 s  1737958651 s          0 s
#8  3501 MHz    6756316 s       1400 s    3319843 s  1740356995 s          0 s

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas64_
  LIBM: libopenlibm
  LLVM: libLLVM-3.7.1 (ORCJIT, haswell)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • "array bool"
  • "array cat"
  • "array comprehension"
  • "array growth"
  • "array index load reverse"
  • "array index setindex!"
  • "array index sum"
  • "array subarray"
  • "blas"
  • "factorization"
  • "iobuffer read"
  • "linalg arithmetic"
  • "micro"
  • "problem go game"
  • "problem grigoriadis khachiyan"
  • "problem imdb graphs"
  • "problem json parse"
  • "problem laplacian"
  • "problem monte carlo"
  • "problem raytrace"
  • "problem seismic simulation"
  • "problem simplex"
  • "problem sparse fem"
  • "problem spellcheck"
  • "problem stockcorr"
  • "problem ziggurat"
  • "scalar arithmetic"
  • "scalar predicate"
  • "shootout binary_trees"
  • "shootout fannkuch"
  • "shootout fasta"
  • "shootout k_nucleotide"
  • "shootout mandelbrot"
  • "shootout meteor_contest"
  • "shootout nbody_vec"
  • "shootout pidigits"
  • "shootout regex_dna"
  • "shootout revcomp"
  • "shootout spectralnorm"
  • "simd"
  • "sort insertionsort"
  • "sort issorted"
  • "sort mergesort"
  • "sort quicksort"
  • "sort sortperm insertionsort"
  • "sort sortperm mergesort"
  • "sort sortperm quicksort"
  • "sparse matrix column indexing"
  • "sparse matrix row + column indexing"
  • "sparse matrix row indexing"
  • "sparse matrix transpose"
  • "sparse vector indexing"
  • "string replace"
  • "tuple indexing"