Skip to content

Latest commit

 

History

History
334 lines (312 loc) · 26.7 KB

report.md

File metadata and controls

334 lines (312 loc) · 26.7 KB

Benchmark Report

Job Properties

Commit(s): JuliaLang/julia@7bf8b524c453af92ded83f1be11206f776c03807 vs JuliaLang/julia@4c5cc04156ba074a8baa028c2a8a41b9e70d56ee

Triggered By: link

Tag Predicate: ALL

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["array","bool","boolarray_true_fill!"] 1.15 (15%) ❌ 1.00 (1%)
["array","cat",("catnd",500)] 1.20 (15%) ❌ 1.00 (1%)
["array","cat",("catnd_setind",5)] 0.95 (15%) 1.01 (1%) ❌
["array","cat",("hcat_setind",5)] 1.50 (15%) ❌ 1.21 (1%) ❌
["array","cat",("hvcat",5)] 1.59 (15%) ❌ 1.29 (1%) ❌
["array","cat",("hvcat_setind",5)] 1.63 (15%) ❌ 1.29 (1%) ❌
["array","cat",("vcat",5)] 1.07 (15%) 1.20 (1%) ❌
["array","cat",("vcat_setind",5)] 1.56 (15%) ❌ 1.21 (1%) ❌
["array","index",("sumcartesian_view","1:100000")] 2.49 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","Array{Float32,2}")] 13.11 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","Array{Float64,3}")] 1.64 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","BaseBenchmarks.ArrayBenchmarks.ArrayLF{Float32,2}")] 13.22 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32,2}")] 5.47 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Float32,2}")] 12.88 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Int32,2}")] 5.90 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2}")] 12.85 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2}")] 6.13 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","BitArray{2}")] 2.14 (50%) ❌ Inf (1%) ❌
["array","index",("sumcartesian_view","SubArray{Float32,2,Array{Float32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 13.19 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Float32,2,Array{Float32,2},Tuple{UnitRange{Int64},UnitRange{Int64}},false}")] 9.63 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Float32,2,Array{Float32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 1.66 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Float32,2,Base.ReshapedArray{Float32,2,SubArray{Float32,3,Array{Float32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true},Tuple{}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},true}")] 1.68 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Float32,2,Base.ReshapedArray{Float32,2,SubArray{Float32,3,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false},Tuple{Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64},Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64}}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},false}")] 2.04 (50%) ❌ Inf (1%) ❌
["array","index",("sumcartesian_view","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 13.15 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 1.70 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Float64,3,Array{Float64,3},Tuple{UnitRange{Int64},UnitRange{Int64},UnitRange{Int64}},false}")] 1.66 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Int32,2,Base.ReshapedArray{Int32,2,SubArray{Int32,3,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false},Tuple{Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64},Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64}}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},false}")] 2.08 (50%) ❌ Inf (1%) ❌
["array","index",("sumcartesian_view","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 6.87 (50%) ❌ 1.00 (1%)
["array","index",("sumcartesian_view","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 2.68 (50%) ❌ 1.00 (1%)
["array","index",("sumcolon_view","1:100000")] 7.81 (50%) ❌ 1.00 (1%)
["array","index",("sumeach","1:100000")] 2.94 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","1:100000")] 2.43 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","Array{Float64,3}")] 1.41 (50%) 1.60 (1%) ❌
["array","index",("sumeach_view","BaseBenchmarks.ArrayBenchmarks.ArrayLF{Float32,2}")] 1.66 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Float32,2}")] 13.00 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Int32,2}")] 6.26 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2}")] 13.33 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2}")] 6.24 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","BitArray{2}")] 1.27 (50%) 1.43 (1%) ❌
["array","index",("sumeach_view","SubArray{Float32,2,Array{Float32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 1.65 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","SubArray{Float32,2,Array{Float32,2},Tuple{UnitRange{Int64},UnitRange{Int64}},false}")] 9.63 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","SubArray{Float32,2,Array{Float32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 1.57 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","SubArray{Float32,2,Base.ReshapedArray{Float32,2,SubArray{Float32,3,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false},Tuple{Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64},Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64}}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},false}")] 3.13 (50%) ❌ Inf (1%) ❌
["array","index",("sumeach_view","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 12.68 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 1.74 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","SubArray{Float64,3,Array{Float64,3},Tuple{UnitRange{Int64},UnitRange{Int64},UnitRange{Int64}},false}")] 1.65 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","SubArray{Int32,2,Base.ReshapedArray{Int32,2,SubArray{Int32,3,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false},Tuple{Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64},Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64}}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},false}")] 2.66 (50%) ❌ Inf (1%) ❌
["array","index",("sumeach_view","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 6.90 (50%) ❌ 1.00 (1%)
["array","index",("sumeach_view","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 2.73 (50%) ❌ 1.00 (1%)
["array","index",("sumlinear","1:100000")] 2.33 (50%) ❌ 1.00 (1%)
["array","index",("sumlinear_view","1:100000")] 2.45 (50%) ❌ 1.00 (1%)
["array","index",("sumlinear_view","Array{Float32,2}")] 3.38 (50%) ❌ 1.60 (1%) ❌
["array","index",("sumlinear_view","Array{Float64,3}")] 1.28 (50%) 1.60 (1%) ❌
["array","index",("sumlinear_view","Array{Int32,2}")] 3.43 (50%) ❌ 1.60 (1%) ❌
["array","index",("sumlinear_view","BaseBenchmarks.ArrayBenchmarks.ArrayLF{Float32,2}")] 17.51 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32,2}")] 31.36 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Float32,2}")] 1.96 (50%) ❌ 2.00 (1%) ❌
["array","index",("sumlinear_view","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Int32,2}")] 1.98 (50%) ❌ 2.00 (1%) ❌
["array","index",("sumlinear_view","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2}")] 1.97 (50%) ❌ 2.00 (1%) ❌
["array","index",("sumlinear_view","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2}")] 1.98 (50%) ❌ 2.00 (1%) ❌
["array","index",("sumlinear_view","BitArray{2}")] 1.27 (50%) 1.43 (1%) ❌
["array","index",("sumlinear_view","SubArray{Float32,2,Array{Float32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 17.29 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Float32,2,Array{Float32,2},Tuple{UnitRange{Int64},UnitRange{Int64}},false}")] 1.92 (50%) ❌ 2.00 (1%) ❌
["array","index",("sumlinear_view","SubArray{Float32,2,Array{Float32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 16.44 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Float32,2,Base.ReshapedArray{Float32,2,SubArray{Float32,3,Array{Float32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true},Tuple{}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},true}")] 9.66 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Float32,2,Base.ReshapedArray{Float32,2,SubArray{Float32,3,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false},Tuple{Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64},Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64}}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},false}")] 1.17 (50%) Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 2.32 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 2.47 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Float64,3,Array{Float64,3},Tuple{UnitRange{Int64},UnitRange{Int64},UnitRange{Int64}},false}")] 1.02 (50%) 1.60 (1%) ❌
["array","index",("sumlinear_view","SubArray{Int32,2,Array{Int32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 21.93 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Int32,2,Array{Int32,2},Tuple{UnitRange{Int64},UnitRange{Int64}},false}")] 1.93 (50%) ❌ 2.00 (1%) ❌
["array","index",("sumlinear_view","SubArray{Int32,2,Array{Int32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true}")] 15.96 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Int32,2,Base.ReshapedArray{Int32,2,SubArray{Int32,3,Array{Int32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},true},Tuple{}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},true}")] 11.45 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Int32,2,Base.ReshapedArray{Int32,2,SubArray{Int32,3,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,3},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false},Tuple{Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64},Base.MultiplicativeInverses.SignedMultiplicativeInverse{Int64}}},Tuple{Base.Slice{Base.OneTo{Int64}},UnitRange{Int64}},false}")] 1.07 (50%) Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 2.32 (50%) ❌ Inf (1%) ❌
["array","index",("sumlinear_view","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 2.49 (50%) ❌ Inf (1%) ❌
["array","index",("sumlogical","BaseBenchmarks.ArrayBenchmarks.ArrayLF{Float32,2}")] 1.66 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32,2}")] 1.69 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Float32,2}")] 1.78 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Int32,2}")] 1.72 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2}")] 1.61 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2}")] 1.53 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","SubArray{Float32,2,Array{Float32,2},Tuple{UnitRange{Int64},UnitRange{Int64}},false}")] 1.94 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 1.59 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","SubArray{Float32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 1.84 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","SubArray{Int32,2,Array{Int32,2},Tuple{UnitRange{Int64},UnitRange{Int64}},false}")] 2.01 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,2},Tuple{Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 1.62 (50%) ❌ 1.00 (1%)
["array","index",("sumlogical","SubArray{Int32,2,BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32,3},Tuple{Int64,Base.Slice{Base.OneTo{Int64}},Base.Slice{Base.OneTo{Int64}}},false}")] 1.78 (50%) ❌ 1.00 (1%)
["array","index",("sumrange","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Float32,2}")] 1.58 (50%) ❌ 1.00 (1%)
["array","index",("sumrange","BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Int32,2}")] 1.51 (50%) ❌ 1.00 (1%)
["array","index",("sumrange_view","1:100000")] 8.12 (50%) ❌ 1.00 (1%)
["broadcast","sparse",((1000,1000),1)] 1.20 (15%) ❌ 1.00 (1%)
["broadcast","sparse",((1000,1000),2)] 1.31 (15%) ❌ 1.00 (1%)
["broadcast","typeargs",("array",10)] 1.17 (15%) ❌ 1.00 (1%)
["io","read","readstring"] 1.11 (15%) 1.02 (1%) ❌
["linalg","arithmetic",("\\","SymTridiagonal","Vector",1024)] 1.62 (45%) ❌ 1.00 (1%)
["linalg","factorization",("svd","Diagonal",256)] 1.83 (45%) ❌ 1.00 (1%)
["linalg","factorization",("svdfact","Diagonal",1024)] 1.52 (45%) ❌ 1.00 (1%)
["linalg","factorization",("svdfact","Diagonal",256)] 1.84 (45%) ❌ 1.00 (1%)
["micro","randmatstat"] 1.03 (15%) 1.02 (1%) ❌
["misc","julia",("macroexpand","evalpoly")] 1.06 (15%) 1.02 (1%) ❌
["misc","repeat",(200,24,1)] 1.18 (15%) ❌ 1.00 (1%)
["nullable","nullablearray",("perf_countequals","NullableArray","Int64")] 1.53 (50%) ❌ 1.00 (1%)
["nullable","nullablearray",("perf_countequals","NullableArray","Int8")] 1.51 (50%) ❌ 1.00 (1%)
["problem","json","parse_json"] 1.05 (15%) 0.99 (1%) ✅
["problem","laplacian","laplace_sparse_matvec"] 1.20 (15%) ❌ 1.00 (1%)
["problem","simplex","simplex"] 1.00 (15%) 1.30 (1%) ❌
["problem","spellcheck","spellcheck"] 1.03 (15%) 0.90 (1%) ✅
["random","collections",("rand","MersenneTwister","large String")] 1.27 (25%) ❌ 1.00 (1%)
["random","ranges",("RangeGenerator","Int16","1:1")] 0.70 (25%) ✅ 1.00 (1%)
["random","ranges",("RangeGenerator","Int8","1:1")] 0.66 (25%) ✅ 1.00 (1%)
["random","ranges",("rand","MersenneTwister","BigInt","RangeGenerator(1:1)")] 1.59 (25%) ❌ 1.01 (1%)
["random","ranges",("rand","MersenneTwister","BigInt","RangeGenerator(1:4294967297)")] 1.52 (25%) ❌ 1.01 (1%)
["random","ranges",("rand","MersenneTwister","UInt128","RangeGenerator(1:170141183460469231731687303715884105728)")] 0.57 (25%) ✅ 1.00 (1%)
["random","types",("rand!","MersenneTwister","Complex{UInt32}")] 1.26 (25%) ❌ 1.00 (1%)
["random","types",("rand","MersenneTwister","Complex{Int16}")] 0.70 (25%) ✅ 1.00 (1%)
["random","types",("rand","MersenneTwister","Int128")] 0.74 (25%) ✅ 1.00 (1%)
["scalar","intfuncs",("prevpow2","Int64","+")] 1.31 (25%) ❌ 1.00 (1%)
["shootout","nbody"] 0.96 (15%) 0.65 (1%) ✅
["simd",("conditional_loop!","Float64",4095)] 0.48 (20%) ✅ 1.00 (1%)
["simd",("conditional_loop!","Float64",4096)] 0.50 (20%) ✅ 1.00 (1%)
["simd",("inner","Float32",4095)] 21.77 (20%) ❌ 1.00 (1%)
["simd",("inner","Float32",4096)] 28.05 (20%) ❌ 1.00 (1%)
["simd",("inner","Float64",4095)] 12.56 (20%) ❌ 1.00 (1%)
["simd",("inner","Float64",4096)] 14.41 (20%) ❌ 1.00 (1%)
["simd",("manual_example!","Float32",4095)] 12.73 (20%) ❌ 1.00 (1%)
["simd",("manual_example!","Float32",4096)] 14.25 (20%) ❌ 1.00 (1%)
["simd",("manual_example!","Float64",4095)] 10.89 (20%) ❌ 1.00 (1%)
["simd",("manual_example!","Float64",4096)] 11.05 (20%) ❌ 1.00 (1%)
["simd",("sum_reduce","Float32",4095)] 21.33 (20%) ❌ 1.00 (1%)
["simd",("sum_reduce","Float32",4096)] 16.98 (20%) ❌ 1.00 (1%)
["simd",("sum_reduce","Float64",4095)] 14.93 (20%) ❌ 1.00 (1%)
["simd",("sum_reduce","Float64",4096)] 15.97 (20%) ❌ 1.00 (1%)
["simd",("two_reductions","Float32",4095)] 18.17 (20%) ❌ 1.00 (1%)
["simd",("two_reductions","Float32",4096)] 17.92 (20%) ❌ 1.00 (1%)
["simd",("two_reductions","Float64",4095)] 13.54 (20%) ❌ 1.00 (1%)
["simd",("two_reductions","Float64",4096)] 14.04 (20%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm forwards","ascending")] 1.39 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm forwards","ones")] 1.37 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm reverse","ascending")] 1.30 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm reverse","descending")] 1.38 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm reverse","ones")] 1.39 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm! forwards","ascending")] 1.43 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm! forwards","descending")] 1.31 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm! forwards","ones")] 1.38 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm! reverse","ascending")] 1.31 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm! reverse","descending")] 1.40 (30%) ❌ 1.00 (1%)
["sort","mergesort",("sortperm! reverse","ones")] 1.41 (30%) ❌ 1.00 (1%)
["sparse","index",("spmat","col","logical",1000)] 0.63 (30%) ✅ 1.00 (1%)
["tuple","linear algebra",("matmat",(4,4),(4,4))] 1.29 (15%) ❌ 1.00 (1%)
["tuple","linear algebra",("matvec",(16,16),(16,))] 1.21 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(16,))] 3.94 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(16,16))] 10.85 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(2,))] 4.08 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(2,2))] 4.18 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(4,))] 4.68 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(4,4))] 3.94 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(8,))] 4.56 (15%) ❌ 1.00 (1%)
["tuple","reduction",("sum",(8,8))] 2.80 (15%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["array","bool"]
  • ["array","cat"]
  • ["array","comprehension"]
  • ["array","convert"]
  • ["array","growth"]
  • ["array","index"]
  • ["array","reductions"]
  • ["array","reverse"]
  • ["array","setindex!"]
  • ["array","subarray"]
  • ["broadcast","dotop"]
  • ["broadcast","fusion"]
  • ["broadcast","mix_scalar_tuple"]
  • ["broadcast","sparse"]
  • ["broadcast","typeargs"]
  • ["dates","accessor"]
  • ["dates","arithmetic"]
  • ["dates","construction"]
  • ["dates","conversion"]
  • ["dates","parse"]
  • ["dates","query"]
  • ["dates","string"]
  • ["io","read"]
  • ["io","serialization"]
  • ["linalg","arithmetic"]
  • ["linalg","blas"]
  • ["linalg","factorization"]
  • ["micro"]
  • ["misc","afoldl"]
  • ["misc","bitshift"]
  • ["misc","julia"]
  • ["misc","parse"]
  • ["misc","repeat"]
  • ["misc","splatting"]
  • ["nullable","basic"]
  • ["nullable","nullablearray"]
  • ["parallel","remotecall"]
  • ["problem","chaosgame"]
  • ["problem","fem"]
  • ["problem","go"]
  • ["problem","grigoriadis khachiyan"]
  • ["problem","imdb"]
  • ["problem","json"]
  • ["problem","laplacian"]
  • ["problem","monte carlo"]
  • ["problem","raytrace"]
  • ["problem","seismic"]
  • ["problem","simplex"]
  • ["problem","spellcheck"]
  • ["problem","stockcorr"]
  • ["problem","ziggurat"]
  • ["random","collections"]
  • ["random","randstring"]
  • ["random","ranges"]
  • ["random","sequences"]
  • ["random","types"]
  • ["scalar","acos"]
  • ["scalar","arithmetic"]
  • ["scalar","asin"]
  • ["scalar","cos"]
  • ["scalar","fastmath"]
  • ["scalar","floatexp"]
  • ["scalar","intfuncs"]
  • ["scalar","iteration"]
  • ["scalar","mod2pi"]
  • ["scalar","predicate"]
  • ["scalar","rem_pio2"]
  • ["scalar","sin"]
  • ["shootout"]
  • ["simd"]
  • ["sort","insertionsort"]
  • ["sort","issorted"]
  • ["sort","mergesort"]
  • ["sort","quicksort"]
  • ["sparse","arithmetic"]
  • ["sparse","index"]
  • ["sparse","transpose"]
  • ["string"]
  • ["string","search"]
  • ["string","searchindex"]
  • ["tuple","index"]
  • ["tuple","linear algebra"]
  • ["tuple","reduction"]

Version Info

Primary Build

Julia Version 0.7.0-DEV.1337
Commit 7bf8b52 (2017-08-13 17:58 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 14.04.4 LTS
  uname: Linux 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3501 MHz   79712541 s          0 s   12286594 s  3729550194 s        134 s
       #2  3501 MHz  318096079 s          0 s   13383741 s  3491585778 s         49 s
       #3  3501 MHz   67867085 s          0 s    7768174 s  3752619403 s         65 s
       #4  3501 MHz   63238064 s          0 s    7704352 s  3757665276 s         22 s
       
  Memory: 31.383651733398438 GB (3291.16015625 MB free)
  Uptime: 3.8299329e7 sec
  Load Avg:  0.9228515625  0.998046875  1.0400390625
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas64_
  LIBM: libopenlibm
  LLVM: libLLVM-3.9.1 (ORCJIT, haswell)

Comparison Build

Julia Version 0.7.0-DEV.1333
Commit 4c5cc04 (2017-08-12 13:47 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 14.04.4 LTS
  uname: Linux 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3501 MHz   79789524 s          0 s   12295748 s  3730076956 s        134 s
       #2  3501 MHz  318652348 s          0 s   13394999 s  3491633083 s         49 s
       #3  3501 MHz   67961536 s          0 s    7775345 s  3753132464 s         65 s
       #4  3501 MHz   63317562 s          0 s    7711576 s  3758193395 s         22 s
       
  Memory: 31.383651733398438 GB (3051.23828125 MB free)
  Uptime: 3.8305483e7 sec
  Load Avg:  1.1103515625  1.0419921875  1.05078125
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas64_
  LIBM: libopenlibm
  LLVM: libLLVM-3.9.1 (ORCJIT, haswell)