Commits: JuliaLang/julia@3105aadf377050edd447d3fa3078ef7913928f69 vs JuliaLang/julia@54e68997108d33a6478bc1bfbbc2b7d1ea072202
Comparison Diff: link
Triggered By: link
Tag Predicate: !"scalar"
Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.
Below is a table of this job's results, obtained by running the benchmarks found in
JuliaCI/BaseBenchmarks.jl. The values
listed in the ID column have the structure [parent_group, child_group, ..., key],
and can be used to index into the BaseBenchmarks suite to retrieve the corresponding
benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).
| ID | time ratio | memory ratio |
|---|---|---|
["alloc", "strings"] |
0.94 (5%) ✅ | 1.00 (1%) |
["array", "cat", ("catnd", 5)] |
1.05 (5%) ❌ | 1.00 (1%) |
["array", "cat", ("hvcat_setind", 5)] |
1.88 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("==", "BitArray")] |
0.87 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "UnitRange{Int64}")] |
0.92 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Int64} == UnitRange{Int64}")] |
1.13 (5%) ❌ | 1.00 (1%) |
["array", "index", "sub2ind"] |
1.55 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumcolon_view", "BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32, 2}")] |
1.51 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumcolon_view", "BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Int32, 2}")] |
1.58 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumcolon_view", "BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}")] |
1.60 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumcolon_view", "SubArray{Int32, 2, Array{Int32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, true}")] |
0.41 (50%) ✅ | 1.00 (1%) |
["array", "index", ("sumcolon_view", "SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
1.75 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumcolon_view", "SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
1.75 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumelt_boundscheck", "100000:-1:1")] |
2.75 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumlinear_view", "1:100000")] |
0.41 (50%) ✅ | 1.00 (1%) |
["array", "index", ("sumrange_view", "BaseBenchmarks.ArrayBenchmarks.ArrayLSLS{Int32, 2}")] |
1.62 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumrange_view", "BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}")] |
1.61 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumrange_view", "SubArray{Int32, 2, Array{Int32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, true}")] |
0.37 (50%) ✅ | 1.00 (1%) |
["array", "index", ("sumrange_view", "SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
1.77 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumrange_view", "SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
1.75 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumvector_view", "SubArray{Int32, 2, Base.ReshapedArray{Int32, 2, SubArray{Int32, 3, Array{Int32, 3}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, true}, Tuple{}}, Tuple{Base.Slice{Base.OneTo{Int64}}, UnitRange{Int64}}, true}")] |
1.63 (50%) ❌ | 1.00 (1%) |
["array", "subarray", ("gramschmidt!", 100)] |
1.27 (5%) ❌ | 1.00 (1%) |
["array", "subarray", ("gramschmidt!", 1000)] |
1.11 (5%) ❌ | 1.00 (1%) |
["array", "subarray", ("gramschmidt!", 250)] |
1.15 (5%) ❌ | 1.00 (1%) |
["array", "subarray", ("gramschmidt!", 500)] |
1.91 (5%) ❌ | 1.00 (1%) |
["broadcast", "26942"] |
1.18 (5%) ❌ | 1.00 (1%) |
["broadcast", "dotop", ("Float64", "(1000, 1000)", 2)] |
6.21 (5%) ❌ | 1.00 (1%) |
["broadcast", "dotop", ("Float64", "(1000000,)", 1)] |
1.53 (5%) ❌ | 1.00 (1%) |
["broadcast", "dotop", ("Float64", "(1000000,)", 2)] |
1.69 (5%) ❌ | 1.00 (1%) |
["broadcast", "fusion", ("Float64", "(1000, 1000)", 2)] |
1.79 (5%) ❌ | 1.00 (1%) |
["broadcast", "fusion", ("Float64", "(1000000,)", 1)] |
1.78 (5%) ❌ | 1.00 (1%) |
["broadcast", "fusion", ("Float64", "(1000000,)", 2)] |
1.79 (5%) ❌ | 1.00 (1%) |
["broadcast", "typeargs", ("array", 3)] |
1.07 (5%) ❌ | 1.00 (1%) |
["broadcast", "typeargs", ("array", 5)] |
1.06 (5%) ❌ | 1.00 (1%) |
["broadcast", "typeargs", ("tuple", 10)] |
0.91 (5%) ✅ | 1.00 (1%) |
["broadcast", "typeargs", ("tuple", 5)] |
0.73 (5%) ✅ | 1.00 (1%) |
["collection", "deletion", ("Set", "Int", "filter!")] |
1.84 (25%) ❌ | 1.00 (1%) |
["collection", "optimizations", ("Vector", "concrete", "Nothing")] |
0.66 (25%) ✅ | 1.00 (1%) |
["dates", "arithmetic", ("Date", "Year")] |
0.82 (5%) ✅ | 1.00 (1%) |
["dates", "parse", ("DateTime", "DateFormat")] |
1.09 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.5", "Vector{Float32}")] |
1.51 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.5", "Vector{Float64}")] |
1.29 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.5", "Vector{Int8}")] |
1.45 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.5", "Vector{UInt64}")] |
1.30 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.5", "Vector{UInt8}")] |
1.45 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.8", "Vector{Float32}")] |
1.66 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.8", "Vector{Float64}")] |
1.30 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.8", "Vector{Int64}")] |
1.06 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.8", "Vector{Int8}")] |
1.55 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.8", "Vector{UInt64}")] |
1.33 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.8", "Vector{UInt8}")] |
1.53 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.95", "Vector{Float32}")] |
1.84 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.95", "Vector{Float64}")] |
1.39 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.95", "Vector{Int64}")] |
1.06 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.95", "Vector{Int8}")] |
1.65 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.95", "Vector{UInt64}")] |
1.36 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.95", "Vector{UInt8}")] |
1.67 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.99", "Vector{Float32}")] |
1.89 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.99", "Vector{Float64}")] |
1.42 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.99", "Vector{Int64}")] |
1.06 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.99", "Vector{Int8}")] |
1.71 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.99", "Vector{UInt64}")] |
1.36 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("> q0.99", "Vector{UInt8}")] |
1.72 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{Float32}")] |
1.35 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{Float64}")] |
1.19 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{Int64}")] |
1.31 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{Int8}")] |
1.63 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{UInt64}")] |
1.25 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{UInt8}")] |
1.43 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Float32}")] |
0.95 (5%) ✅ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{UInt64}")] |
0.94 (5%) ✅ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{UInt8}")] |
1.06 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("BitVector", "10-90")] |
1.06 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{Int8}")] |
1.06 (5%) ❌ | 1.00 (1%) |
["inference", "abstract interpretation", "domsort_ssa!"] |
0.97 (5%) | 1.02 (1%) ❌ |
["inference", "abstract interpretation", "many_invoke_calls"] |
0.92 (5%) ✅ | 1.00 (1%) |
["inference", "abstract interpretation", "many_opaque_closures"] |
0.99 (5%) | 1.01 (1%) ❌ |
["inference", "optimization", "Base.init_stdio(::Ptr{Cvoid})"] |
0.94 (5%) ✅ | 1.00 (1%) |
["linalg", "arithmetic", ("*", "typename(SymTridiagonal)", "typename(SymTridiagonal)", 1024)] |
0.24 (45%) ✅ | 1.00 (1%) |
["linalg", "arithmetic", ("+", "Matrix", "Matrix", 256)] |
1.52 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("+", "typename(Diagonal)", "typename(Diagonal)", 1024)] |
1.46 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("+", "typename(LowerTriangular)", "typename(LowerTriangular)", 256)] |
1.49 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("+", "typename(SymTridiagonal)", "typename(SymTridiagonal)", 1024)] |
1.50 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("+", "typename(UpperTriangular)", "typename(UpperTriangular)", 256)] |
1.52 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("-", "Matrix", "Matrix", 256)] |
1.48 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("-", "typename(Bidiagonal)", "typename(Bidiagonal)", 1024)] |
1.48 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("-", "typename(LowerTriangular)", "typename(LowerTriangular)", 256)] |
1.53 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("-", "typename(SymTridiagonal)", "typename(SymTridiagonal)", 1024)] |
1.50 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("-", "typename(UpperTriangular)", "typename(UpperTriangular)", 256)] |
1.53 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("/", "typename(Diagonal)", "typename(Diagonal)", 1024)] |
1.66 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("/", "typename(Diagonal)", "typename(Diagonal)", 256)] |
1.50 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("\\", "typename(Diagonal)", "Vector", 1024)] |
1.66 (45%) ❌ | 1.00 (1%) |
["linalg", "arithmetic", ("\\", "typename(Diagonal)", "Vector", 256)] |
1.49 (45%) ❌ | 1.00 (1%) |
["linalg", "small exp #29116"] |
0.81 (5%) ✅ | 1.00 (1%) |
["micro", "pisum"] |
0.60 (5%) ✅ | 1.00 (1%) |
["misc", "afoldl", "Int"] |
0.31 (5%) ✅ | 1.00 (1%) |
["misc", "allocation elision view", "conditional"] |
0.73 (5%) ✅ | 1.00 (1%) |
["misc", "allocation elision view", "no conditional"] |
1.53 (5%) ❌ | 1.00 (1%) |
["misc", "bitshift", ("Int", "Int")] |
1.06 (5%) ❌ | 1.00 (1%) |
["misc", "foldl", "foldl(+, filter(...); init = 0.0)"] |
0.94 (5%) ✅ | 1.00 (1%) |
["misc", "iterators", "zip(1:1000, 1:1000, 1:1000)"] |
0.93 (5%) ✅ | 1.00 (1%) |
["problem", "laplacian", "laplace_iter_devec"] |
1.09 (5%) ❌ | 1.00 (1%) |
["problem", "laplacian", "laplace_iter_sub"] |
1.10 (5%) ❌ | 1.00 (1%) |
["problem", "laplacian", "laplace_iter_vec"] |
1.28 (5%) ❌ | 1.00 (1%) |
["problem", "monte carlo", "euro_option_vec"] |
1.09 (5%) ❌ | 1.00 (1%) |
["random", "collections", ("rand", "ImplicitRNG", "large Vector")] |
0.65 (25%) ✅ | 1.00 (1%) |
["random", "collections", ("rand", "ImplicitRNG", "small Vector")] |
0.65 (25%) ✅ | 1.00 (1%) |
["random", "ranges", ("rand", "ImplicitRNG", "Int", "1:1000")] |
0.65 (25%) ✅ | 1.00 (1%) |
["shootout", "nbody_vec"] |
1.10 (5%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float32", 2, 32)] |
1.30 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float32", 3, 32)] |
1.69 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float32", 3, 63)] |
1.22 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float32", 3, 64)] |
1.41 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float64", 3, 31)] |
1.30 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float64", 3, 32)] |
1.38 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float64", 3, 63)] |
1.26 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float64", 3, 64)] |
1.24 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Int32", 3, 32)] |
1.61 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Int32", 3, 64)] |
1.44 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Int64", 3, 32)] |
1.30 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "conditional_loop!", "Int32", 2, 31)] |
2.13 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Float64", 3, 64)] |
1.36 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Float64", 4, 64)] |
1.21 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 3, 31)] |
1.27 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 3, 32)] |
1.57 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 3, 63)] |
1.33 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 3, 64)] |
1.41 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 4, 31)] |
1.25 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 4, 32)] |
1.47 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 4, 64)] |
1.41 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int64", 3, 31)] |
1.35 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int64", 3, 32)] |
1.21 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int64", 4, 31)] |
1.23 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int64", 4, 32)] |
1.28 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Float32", 3, 32)] |
1.22 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Float64", 3, 32)] |
1.44 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Int32", 3, 31)] |
1.44 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Int32", 3, 32)] |
1.36 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Int32", 3, 63)] |
1.33 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Int32", 3, 64)] |
1.25 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Int64", 2, 31)] |
1.22 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Int64", 3, 31)] |
1.28 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Float32", 3, 32)] |
1.24 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Float32", 3, 64)] |
1.38 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Float64", 3, 32)] |
1.30 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Float64", 3, 64)] |
1.30 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Int64", 2, 32)] |
1.26 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Int64", 3, 31)] |
1.45 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Int64", 3, 32)] |
1.42 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Int64", 3, 63)] |
1.28 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "two_reductions", "Int64", 3, 64)] |
1.24 (20%) ❌ | 1.00 (1%) |
["sparse", "constructors", ("Diagonal", 10)] |
0.94 (5%) ✅ | 1.00 (1%) |
["sparse", "constructors", ("IV", 10)] |
1.05 (5%) ❌ | 1.00 (1%) |
["sparse", "constructors", ("SymTridiagonal", 100)] |
1.06 (5%) ❌ | 1.00 (1%) |
["sparse", "matmul", ("Ac_mul_B!", "sparse 200x2000, dense 200x20 -> dense 2000x20")] |
0.59 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_B", "dense 500x5, sparse 500x50 -> dense 5x50")] |
0.61 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_B", "dense 500x5, sparse 500x500 -> dense 5x500")] |
0.56 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_B", "dense 50x5, sparse 50x500 -> dense 5x500")] |
0.54 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_B", "dense 50x50, sparse 50x50 -> dense 50x50")] |
0.58 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_B", "dense 5x5, sparse 5x500 -> dense 5x500")] |
0.58 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_B", "dense 5x50, sparse 5x50 -> dense 50x50")] |
0.61 (30%) ✅ | 1.00 (1%) |
["string", "==(::AbstractString, ::AbstractString)", "different"] |
0.92 (5%) ✅ | 1.00 (1%) |
["string", "==(::SubString, ::String)", "different"] |
0.83 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "backtracking"] |
0.95 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "barbarian backtrack"] |
0.94 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "target length 1000"] |
0.87 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "target length 2"] |
0.94 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "target length 50000"] |
0.93 (5%) ✅ | 1.00 (1%) |
["string", "repeat", "repeat str len 16"] |
1.08 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matmat", "(2, 2)", "(2, 2)")] |
0.88 (5%) ✅ | 1.00 (1%) |
["tuple", "linear algebra", ("matmat", "(8, 8)", "(8, 8)")] |
1.06 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(16, 16)", "(16,)")] |
1.12 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(2, 2)", "(2,)")] |
1.06 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(4, 4)", "(4,)")] |
0.89 (5%) ✅ | 1.00 (1%) |
["tuple", "reduction", ("minimum", "(2,)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["tuple", "reduction", ("sum", "(16, 16)")] |
2.29 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sum", "(16,)")] |
1.09 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sum", "(2, 2)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["tuple", "reduction", ("sum", "(4,)")] |
1.06 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sum", "(8, 8)")] |
1.17 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sumabs", "(16,)")] |
0.92 (5%) ✅ | 1.00 (1%) |
["tuple", "reduction", ("sumabs", "(4,)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(false, false)")] |
1.19 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(false, true)")] |
1.24 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(true, true)")] |
1.19 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "ComplexF64", "(false, false)")] |
1.12 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "ComplexF64", "(false, true)")] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "ComplexF64", "(true, true)")] |
1.11 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(false, false)")] |
1.57 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(false, true)")] |
1.37 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(true, true)")] |
1.32 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float64", "(false, false)")] |
1.57 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float64", "(false, true)")] |
1.35 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float64", "(true, true)")] |
1.31 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int64", "(false, false)")] |
1.57 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int64", "(false, true)")] |
1.32 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int64", "(true, true)")] |
1.31 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int8", "(false, false)")] |
1.59 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int8", "(false, true)")] |
1.25 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int8", "(true, true)")] |
1.19 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Bool", 1)] |
1.40 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "ComplexF64", 0)] |
1.05 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "ComplexF64", 1)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Float32", 1)] |
1.29 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Float64", 1)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Int64", 1)] |
1.22 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "BigFloat", 1)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "BigInt", 1)] |
1.11 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Bool", 1)] |
1.39 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "ComplexF64", 1)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Float32", 1)] |
1.33 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Float64", 1)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Int64", 1)] |
1.22 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Int8", 1)] |
1.39 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "BigFloat", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "all", "Float32", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(false, false)")] |
0.92 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(false, true)")] |
1.27 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(true, true)")] |
1.23 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Float32", "(false, false)")] |
1.14 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Float64", "(false, false)")] |
1.14 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Float64", "(false, true)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Int64", "(false, false)")] |
1.14 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Int8", "(false, true)")] |
1.18 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Int8", "(true, true)")] |
1.26 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Bool", 1)] |
0.78 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "abs", "Float64", 1)] |
0.87 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "identity", "BigFloat", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "identity", "BigFloat", 1)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "identity", "Float32", 1)] |
1.05 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float32", "(false, true)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_countequals", "ComplexF64")] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_countequals", "Int64")] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_simplecopy", "Bool", 1)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum3", "Bool", 0)] |
1.05 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "filter", "Bool", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Int64", 0)] |
1.05 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Int8", 0)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, ComplexF64}", 1)] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Float32}", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Float64}", 1)] |
0.92 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Nothing, BigFloat}", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "ComplexF64", 0)] |
2.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Float32", 0)] |
1.55 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Float64", 0)] |
1.26 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Int64", 0)] |
1.27 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Int8", 0)] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("sort", "Union{Missing, Bool}", 1)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Missing, Float32}", 1)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Missing, Float64}", 1)] |
1.12 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Missing, Int64}", 1)] |
1.14 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Missing, Int8}", 1)] |
1.11 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Bool}", 0)] |
1.30 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Float32}", 0)] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Float64}", 0)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Int64}", 0)] |
1.22 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Int8}", 0)] |
1.25 (5%) ❌ | 1.00 (1%) |
Here's a list of all the benchmark groups executed by this job:
["alloc"]["array", "accumulate"]["array", "any/all"]["array", "bool"]["array", "cat"]["array", "comprehension"]["array", "convert"]["array", "equality"]["array", "growth"]["array", "index"]["array", "reductions"]["array", "reverse"]["array", "setindex!"]["array", "subarray"]["broadcast"]["broadcast", "dotop"]["broadcast", "fusion"]["broadcast", "mix_scalar_tuple"]["broadcast", "sparse"]["broadcast", "typeargs"]["collection", "deletion"]["collection", "initialization"]["collection", "iteration"]["collection", "optimizations"]["collection", "queries & updates"]["collection", "set operations"]["dates", "accessor"]["dates", "arithmetic"]["dates", "construction"]["dates", "conversion"]["dates", "parse"]["dates", "query"]["dates", "string"]["find", "findall"]["find", "findnext"]["find", "findprev"]["frontend"]["inference", "abstract interpretation"]["inference", "allinference"]["inference", "optimization"]["io", "array_limit"]["io", "read"]["io", "serialization"]["io"]["linalg", "arithmetic"]["linalg", "blas"]["linalg", "factorization"]["linalg"]["micro"]["misc"]["misc", "23042"]["misc", "afoldl"]["misc", "allocation elision view"]["misc", "bitshift"]["misc", "foldl"]["misc", "issue 12165"]["misc", "iterators"]["misc", "julia"]["misc", "parse"]["misc", "repeat"]["misc", "splatting"]["problem", "chaosgame"]["problem", "fem"]["problem", "go"]["problem", "grigoriadis khachiyan"]["problem", "imdb"]["problem", "json"]["problem", "laplacian"]["problem", "monte carlo"]["problem", "raytrace"]["problem", "seismic"]["problem", "simplex"]["problem", "spellcheck"]["problem", "stockcorr"]["problem", "ziggurat"]["random", "collections"]["random", "randstring"]["random", "ranges"]["random", "sequences"]["random", "types"]["shootout"]["simd"]["sort", "insertionsort"]["sort", "issorted"]["sort", "mergesort"]["sort", "quicksort"]["sparse", "arithmetic"]["sparse", "constructors"]["sparse", "index"]["sparse", "matmul"]["sparse", "sparse matvec"]["sparse", "sparse solves"]["sparse", "transpose"]["string", "==(::AbstractString, ::AbstractString)"]["string", "==(::SubString, ::String)"]["string", "findfirst"]["string"]["string", "readuntil"]["string", "repeat"]["tuple", "index"]["tuple", "linear algebra"]["tuple", "misc"]["tuple", "reduction"]["union", "array"]
Julia Version 1.9.0-DEV.1642
Commit 3105aadf37 (2022-10-23 19:58 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 20.04.4 LTS
uname: Linux 5.4.0-122-generic #138-Ubuntu SMP Wed Jun 22 15:00:31 UTC 2022 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz:
speed user nice sys idle irq
#1 2639 MHz 181753 s 375 s 42014 s 64597122 s 0 s
#2 3009 MHz 4598966 s 126 s 139749 s 60123971 s 0 s
#3 2936 MHz 213419 s 177 s 34189 s 64612435 s 0 s
#4 3411 MHz 154159 s 184 s 33186 s 64632174 s 0 s
#5 2921 MHz 196431 s 78 s 33413 s 64293804 s 0 s
#6 3444 MHz 162946 s 138 s 32833 s 64652309 s 0 s
#7 3465 MHz 202438 s 224 s 33842 s 64627137 s 0 s
#8 2990 MHz 186254 s 131 s 33018 s 64619160 s 0 s
Memory: 31.320838928222656 GB (16930.48828125 MB free)
Uptime: 6.49161225e6 sec
Load Avg: 1.0 1.0 1.0
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-14.0.6 (ORCJIT, haswell)
Threads: 1 on 8 virtual cores
Julia Version 1.9.0-DEV.1637
Commit 54e6899710 (2022-10-23 04:10 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 20.04.4 LTS
uname: Linux 5.4.0-122-generic #138-Ubuntu SMP Wed Jun 22 15:00:31 UTC 2022 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz:
speed user nice sys idle irq
#1 3168 MHz 182376 s 375 s 42184 s 64698286 s 0 s
#2 3150 MHz 4696748 s 126 s 142211 s 60125929 s 0 s
#3 3117 MHz 213916 s 177 s 34204 s 64714108 s 0 s
#4 2965 MHz 154200 s 184 s 33192 s 64734240 s 0 s
#5 3000 MHz 196482 s 78 s 33419 s 64395801 s 0 s
#6 2671 MHz 163004 s 138 s 32839 s 64754446 s 0 s
#7 3276 MHz 202927 s 224 s 33853 s 64728830 s 0 s
#8 3147 MHz 186658 s 131 s 33027 s 64720938 s 0 s
Memory: 31.320838928222656 GB (17283.11328125 MB free)
Uptime: 6.50183261e6 sec
Load Avg: 1.0 1.0 1.0
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-14.0.6 (ORCJIT, haswell)
Threads: 1 on 8 virtual cores