Commits: pchintalapudi/julia@f912f69de3e582db366b84230bfd302507ff0ca0 vs JuliaLang/julia@b57d2e17f7cdffd15fbdd5f13a8e5277ba1e4df6
Comparison Diff: link
Triggered By: link
Tag Predicate: !"scalar"
Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.
Below is a table of this job's results, obtained by running the benchmarks found in
JuliaCI/BaseBenchmarks.jl. The values
listed in the ID column have the structure [parent_group, child_group, ..., key],
and can be used to index into the BaseBenchmarks suite to retrieve the corresponding
benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).
| ID | time ratio | memory ratio |
|---|---|---|
["array", "accumulate", ("cumsum!", "Float64", "dim2")] |
0.70 (5%) ✅ | 1.00 (1%) |
["array", "accumulate", ("cumsum!", "Int")] |
1.10 (5%) ❌ | 1.00 (1%) |
["array", "accumulate", ("cumsum", "Float64", "dim2")] |
0.82 (5%) ✅ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Float32} generator")] |
0.78 (5%) ✅ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Float32}")] |
1.29 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Float64}")] |
0.79 (5%) ✅ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Float32} generator")] |
1.30 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Float32}")] |
1.29 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Float64} generator")] |
1.27 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Float64}")] |
0.79 (5%) ✅ | 1.00 (1%) |
["array", "bool", "bitarray_bool_load!"] |
1.06 (5%) ❌ | 1.00 (1%) |
["array", "cat", ("hvcat_setind", 5)] |
0.91 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "UnitRange{Int64}")] |
0.84 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Bool}")] |
1.41 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Int64} == Vector{Float32}")] |
1.42 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Int64} == Vector{Float64}")] |
0.68 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "BitArray")] |
1.25 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "UnitRange{Int64}")] |
0.84 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Bool}")] |
1.41 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Float32}")] |
0.84 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Float64}")] |
0.88 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int64} isequal UnitRange{Int64}")] |
0.76 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Float32}")] |
1.26 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Int64}")] |
0.91 (5%) ✅ | 1.00 (1%) |
["array", "growth", ("push_multiple!", 2048)] |
1.07 (5%) ❌ | 1.00 (1%) |
["array", "growth", ("push_multiple!", 256)] |
1.06 (5%) ❌ | 1.00 (1%) |
["array", "growth", ("push_single!", 2048)] |
0.93 (5%) ✅ | 1.00 (1%) |
["array", "growth", ("push_single!", 256)] |
0.95 (5%) ✅ | 1.00 (1%) |
["array", "growth", ("push_single!", 8)] |
0.91 (5%) ✅ | 1.00 (1%) |
["array", "index", ("sumelt", "Base.ReinterpretArray{Int32, 3, Float64, Array{Float64, 3}, false}")] |
1.55 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumelt_boundscheck", "BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32, 2}")] |
0.39 (50%) ✅ | 1.00 (1%) |
["array", "reductions", ("norm1", "Float64")] |
0.94 (5%) ✅ | 1.00 (1%) |
["array", "reductions", ("perf_reduce", "Int64")] |
0.95 (5%) ✅ | 1.00 (1%) |
["broadcast", "26942"] |
0.61 (5%) ✅ | 1.00 (1%) |
["broadcast", "mix_scalar_tuple", (3, "scal_tup")] |
0.84 (5%) ✅ | 1.00 (1%) |
["broadcast", "mix_scalar_tuple", (5, "tup_tup")] |
1.19 (5%) ❌ | 1.00 (1%) |
["broadcast", "typeargs", ("array", 5)] |
0.94 (5%) ✅ | 1.00 (1%) |
["collection", "deletion", ("IdDict", "Int", "filter!")] |
0.63 (25%) ✅ | 1.00 (1%) |
["collection", "deletion", ("Vector", "Any", "pop!")] |
0.48 (25%) ✅ | 1.00 (1%) |
["collection", "deletion", ("Vector", "Int", "pop!")] |
0.50 (25%) ✅ | 1.00 (1%) |
["collection", "deletion", ("Vector", "String", "pop!")] |
0.49 (25%) ✅ | 1.00 (1%) |
["collection", "initialization", ("Dict", "Int", "loop")] |
0.68 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Dict", "Any", "iterate second")] |
0.56 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Dict", "Any", "iterate")] |
0.65 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Dict", "String", "iterate second")] |
0.64 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Dict", "String", "iterate")] |
0.64 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("IdDict", "Any", "iterate second")] |
0.43 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("IdDict", "Any", "iterate")] |
0.44 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("IdDict", "Int", "iterate second")] |
0.47 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("IdDict", "Int", "iterate")] |
0.44 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("IdDict", "String", "iterate second")] |
0.50 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("IdDict", "String", "iterate")] |
0.45 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Set", "String", "iterate second")] |
0.65 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Set", "String", "iterate")] |
0.58 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Vector", "String", "iterate second")] |
0.61 (25%) ✅ | 1.00 (1%) |
["collection", "iteration", ("Vector", "String", "iterate")] |
0.63 (25%) ✅ | 1.00 (1%) |
["collection", "optimizations", ("BitSet", "Int8")] |
1.26 (25%) ❌ | 1.00 (1%) |
["collection", "optimizations", ("Dict", "abstract", "Nothing")] |
0.63 (25%) ✅ | 1.00 (1%) |
["collection", "optimizations", ("Dict", "concrete", "Nothing")] |
0.63 (25%) ✅ | 1.00 (1%) |
["collection", "optimizations", ("IdDict", "abstract", "Nothing")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "optimizations", ("IdDict", "concrete", "Nothing")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "optimizations", ("Set", "concrete", "Nothing")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Dict", "Int", "pop!", "unspecified")] |
0.71 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Dict", "Int", "push!", "new")] |
0.58 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Dict", "Int", "push!", "overwrite")] |
0.55 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Dict", "Int", "setindex!", "new")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Dict", "Int", "setindex!", "overwrite")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Dict", "String", "in", "true")] |
0.75 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Any", "in", "false")] |
0.70 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Any", "in", "true")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Any", "push!", "new")] |
0.73 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Any", "push!", "overwrite")] |
0.73 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Any", "setindex!", "new")] |
0.71 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Any", "setindex!", "overwrite")] |
0.75 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Int", "first")] |
0.42 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "Int", "in", "true")] |
0.69 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("IdDict", "String", "in", "true")] |
0.64 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Set", "Int", "in", "false")] |
0.47 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Set", "Int", "in", "true")] |
0.46 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Set", "Int", "pop!", "unspecified")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Set", "Int", "push!", "new")] |
0.59 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Set", "Int", "push!", "overwrite")] |
0.56 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Set", "String", "in", "true")] |
0.69 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "Any", "in", "false")] |
0.75 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "Any", "pop!", "unspecified")] |
0.44 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "Any", "push!")] |
0.65 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "Any", "setindex!")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "Int", "pop!", "unspecified")] |
0.45 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "Int", "push!")] |
0.60 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "String", "in", "false")] |
0.28 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "String", "in", "true")] |
0.39 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "String", "pop!", "unspecified")] |
0.46 (25%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("Vector", "String", "push!")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "intersect!", "big")] |
0.63 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "intersect", "Set", "Set")] |
0.70 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "intersect", "Vector")] |
0.70 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "union!", "Set")] |
1.27 (25%) ❌ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "⊆", "self")] |
1.30 (25%) ❌ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "==", "self")] |
0.69 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "intersect", "BitSet")] |
0.70 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "intersect", "BitSet", "BitSet")] |
0.73 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "intersect", "Set")] |
0.73 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "intersect", "Set", "Set")] |
0.71 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "intersect", "Vector")] |
0.67 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "intersect", "Vector", "Vector")] |
0.75 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "setdiff!", "BitSet")] |
0.54 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "setdiff!", "Set")] |
0.54 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "symdiff", "BitSet")] |
0.75 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "symdiff", "BitSet", "BitSet")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "symdiff", "Set")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "symdiff", "Set", "Set")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "symdiff", "Vector")] |
0.75 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "symdiff", "Vector", "Vector")] |
0.75 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "union!", "BitSet")] |
0.58 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "union!", "Set")] |
0.56 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "⊆", "BitSet")] |
1.35 (25%) ❌ | 1.00 (1%) |
["collection", "set operations", ("Set", "Int", "⊆", "self")] |
0.69 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "intersect")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "symdiff")] |
0.74 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "symdiff", "BitSet")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "symdiff", "BitSet", "BitSet")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "symdiff", "Set")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "symdiff", "Set", "Set")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "symdiff", "Vector")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "symdiff", "Vector", "Vector")] |
0.72 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "union")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "union", "BitSet")] |
0.61 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "union", "BitSet", "BitSet")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "union", "Set")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "union", "Set", "Set")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "union", "Vector")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "union", "Vector", "Vector")] |
0.62 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("Vector", "Int", "⊆", "Set")] |
0.60 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("empty", "Int", "⊆", "BitSet")] |
1.26 (25%) ❌ | 1.00 (1%) |
["dates", "accessor", "hour"] |
0.94 (5%) ✅ | 1.00 (1%) |
["dates", "accessor", "minute"] |
1.10 (5%) ❌ | 1.00 (1%) |
["dates", "accessor", "second"] |
1.09 (5%) ❌ | 1.00 (1%) |
["dates", "conversion", "DateTime -> Date"] |
1.16 (5%) ❌ | 1.00 (1%) |
["find", "findall", ("BitVector", "10-90")] |
0.94 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("Vector{Bool}", "10-90")] |
1.05 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("Vector{Bool}", "50-50")] |
1.54 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Bool}")] |
1.19 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Float32}")] |
1.17 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Float64}")] |
1.33 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Int64}")] |
1.27 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Int8}")] |
1.18 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{UInt64}")] |
1.23 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{UInt8}")] |
1.17 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("BitVector", "90-10")] |
0.89 (5%) ✅ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{Bool}")] |
1.22 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{Float32}")] |
1.21 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{Float64}")] |
1.29 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{Int64}")] |
1.19 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{Int8}")] |
1.22 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{UInt64}")] |
1.26 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{UInt8}")] |
1.19 (5%) ❌ | 1.00 (1%) |
["io", "read", "read"] |
0.75 (5%) ✅ | 1.00 (1%) |
["micro", "randmatmul"] |
0.95 (5%) ✅ | 1.00 (1%) |
["micro", "randmatstat"] |
0.94 (5%) ✅ | 1.00 (1%) |
["misc", "18129"] |
1.18 (5%) ❌ | 1.00 (1%) |
["misc", "foldl", "foldl(+, filter(...))"] |
0.91 (5%) ✅ | 1.00 (1%) |
["misc", "foldl", "foldl(+, filter(...); init = 0.0)"] |
0.83 (5%) ✅ | 1.00 (1%) |
["misc", "iterators", "zip(1:1000, 1:1000)"] |
1.14 (5%) ❌ | 1.00 (1%) |
["misc", "parse", "Int"] |
0.90 (5%) ✅ | 1.00 (1%) |
["misc", "splatting", (3, 3, 3)] |
1.06 (5%) ❌ | 1.00 (1%) |
["problem", "laplacian", "laplace_iter_devec"] |
1.09 (5%) ❌ | 1.00 (1%) |
["problem", "laplacian", "laplace_iter_vec"] |
1.07 (5%) ❌ | 1.00 (1%) |
["problem", "stockcorr", "stockcorr"] |
0.89 (5%) ✅ | 1.00 (1%) |
["shootout", "fannkuch"] |
1.08 (5%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Int32", 3, 31)] |
1.29 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "conditional_loop!", "Int32", 4, 32)] |
0.76 (20%) ✅ | 1.00 (1%) |
["simd", ("Cartesian", "inner", "Int32", 3, 63)] |
1.23 (20%) ❌ | 1.00 (1%) |
["simd", ("CartesianPartition", "axpy!", "Int32", 3, 31)] |
1.26 (20%) ❌ | 1.00 (1%) |
["simd", ("CartesianPartition", "inner", "Int32", 2, 31)] |
1.33 (20%) ❌ | 1.00 (1%) |
["simd", ("CartesianPartition", "inner", "Int32", 4, 31)] |
1.21 (20%) ❌ | 1.00 (1%) |
["simd", ("Linear", "manual_example!", "Float32", 4095)] |
0.76 (20%) ✅ | 1.00 (1%) |
["sort", "insertionsort", ("sort! forwards", "ascending")] |
1.51 (30%) ❌ | 1.00 (1%) |
["sort", "insertionsort", ("sortperm! forwards", "ascending")] |
0.66 (30%) ✅ | 1.00 (1%) |
["sparse", "constructors", ("IJV", 100)] |
1.07 (5%) ❌ | 1.00 (1%) |
["sparse", "constructors", ("IJV", 1000)] |
1.05 (5%) ❌ | 1.00 (1%) |
["sparse", "constructors", ("IV", 1000)] |
0.90 (5%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("A_mul_Bc!", "sparse 2000x200, dense 20x200 -> dense 2000x20")] |
0.68 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("A_mul_Bc", "sparse 50x500, dense 5x500 -> dense 50x5")] |
0.65 (30%) ✅ | 1.00 (1%) |
["sparse", "sparse matvec", "non-adjoint"] |
1.08 (5%) ❌ | 1.00 (1%) |
["sparse", "sparse solves", "square system (lu), matrix rhs"] |
0.94 (5%) ✅ | 1.00 (1%) |
["sparse", "sparse solves", "square system (lu), vector rhs"] |
0.94 (5%) ✅ | 1.00 (1%) |
["string", "findfirst", "Char"] |
0.89 (5%) ✅ | 1.00 (1%) |
["string", "findfirst", "String"] |
0.92 (5%) ✅ | 1.00 (1%) |
["string", "repeat", "repeat str len 16"] |
1.15 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matmat", "(16, 16)", "(16, 16)")] |
1.17 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matmat", "(8, 8)", "(8, 8)")] |
1.13 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(16, 16)", "(16,)")] |
1.20 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("minimum", "(2, 2)")] |
1.18 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("minimum", "(4,)")] |
1.06 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sum", "(16,)")] |
1.39 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sumabs", "(2,)")] |
1.29 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(false, false)")] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(false, true)")] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(true, true)")] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "ComplexF64", "(false, false)")] |
0.79 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(false, false)")] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(false, true)")] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int64", "(false, true)")] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "ComplexF64", 0)] |
1.66 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "ComplexF64", 1)] |
1.37 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Int64", 0)] |
1.39 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Int8", 0)] |
0.80 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "BigInt", 0)] |
0.83 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "BigInt", 1)] |
1.14 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Bool", 0)] |
0.83 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Int8", 1)] |
0.92 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "all", "Bool", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "all", "ComplexF64", 1)] |
1.05 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Float32", 1)] |
1.18 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Float64", 1)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Int64", 1)] |
0.88 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "filter", "Float32", 0)] |
1.07 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "filter", "Float64", 0)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "filter", "Int8", 0)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(false, false)")] |
0.78 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(false, true)")] |
0.86 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(true, true)")] |
0.79 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "ComplexF64", "(false, false)")] |
1.22 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "ComplexF64", "(false, true)")] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "ComplexF64", "(true, true)")] |
1.11 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Int64", "(false, false)")] |
0.84 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Int8", "(false, false)")] |
1.25 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Bool", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "ComplexF64", 0)] |
1.65 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "ComplexF64", 1)] |
1.45 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Float32", 0)] |
0.72 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "abs", "Int8", 1)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "identity", "Bool", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "identity", "ComplexF64", 1)] |
1.05 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Float32", 1)] |
1.18 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Float64", 1)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Int64", 1)] |
0.88 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Bool", "(false, false)")] |
0.79 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Bool", "(false, true)")] |
0.80 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Bool", "(true, true)")] |
0.81 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "ComplexF64", "(false, false)")] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "ComplexF64", "(false, true)")] |
0.91 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "ComplexF64", "(true, true)")] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float32", "(false, false)")] |
0.88 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float32", "(false, true)")] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float32", "(true, true)")] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float64", "(false, false)")] |
0.82 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float64", "(false, true)")] |
0.79 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float64", "(true, true)")] |
0.81 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int64", "(false, false)")] |
0.87 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int64", "(false, true)")] |
0.83 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int64", "(true, true)")] |
0.85 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int8", "(false, false)")] |
0.91 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int8", "(false, true)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int8", "(true, true)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_countequals", "BigInt")] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_countequals", "Bool")] |
0.88 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_countequals", "ComplexF64")] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_countequals", "Float32")] |
1.36 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_countequals", "Int64")] |
1.12 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_countequals", "Int8")] |
0.88 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_simplecopy", "BigFloat", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_simplecopy", "BigInt", 1)] |
0.86 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum", "BigInt", 0)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum", "BigInt", 1)] |
1.07 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum2", "BigInt", 0)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum2", "BigInt", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum2", "Bool", 1)] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum3", "BigInt", 0)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum3", "BigInt", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum3", "ComplexF64", 1)] |
1.21 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum3", "Float32", 1)] |
0.87 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum3", "Float64", 1)] |
1.15 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum4", "BigInt", 0)] |
1.07 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Union{Missing, Float32}", 1)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Union{Missing, Int64}", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "BigInt", 0)] |
1.12 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "Int8", 0)] |
0.84 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "Union{Missing, BigInt}", 1)] |
1.07 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "Union{Missing, ComplexF64}", 1)] |
0.79 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "Union{Nothing, BigInt}", 0)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Float32", 0)] |
0.92 (5%) ✅ | 1.00 (1%) |
["union", "array", ("sort", "Union{Missing, Float64}", 1)] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Bool}", 0)] |
1.29 (5%) ❌ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Int8}", 0)] |
0.94 (5%) ✅ | 1.00 (1%) |
Here's a list of all the benchmark groups executed by this job:
["array", "accumulate"]["array", "any/all"]["array", "bool"]["array", "cat"]["array", "comprehension"]["array", "convert"]["array", "equality"]["array", "growth"]["array", "index"]["array", "reductions"]["array", "reverse"]["array", "setindex!"]["array", "subarray"]["broadcast"]["broadcast", "dotop"]["broadcast", "fusion"]["broadcast", "mix_scalar_tuple"]["broadcast", "sparse"]["broadcast", "typeargs"]["collection", "deletion"]["collection", "initialization"]["collection", "iteration"]["collection", "optimizations"]["collection", "queries & updates"]["collection", "set operations"]["dates", "accessor"]["dates", "arithmetic"]["dates", "construction"]["dates", "conversion"]["dates", "parse"]["dates", "query"]["dates", "string"]["find", "findall"]["find", "findnext"]["find", "findprev"]["frontend"]["io", "array_limit"]["io", "read"]["io", "serialization"]["io"]["linalg", "arithmetic"]["linalg", "blas"]["linalg", "factorization"]["linalg"]["micro"]["misc"]["misc", "23042"]["misc", "afoldl"]["misc", "allocation elision view"]["misc", "bitshift"]["misc", "foldl"]["misc", "issue 12165"]["misc", "iterators"]["misc", "julia"]["misc", "parse"]["misc", "repeat"]["misc", "splatting"]["problem", "chaosgame"]["problem", "fem"]["problem", "go"]["problem", "grigoriadis khachiyan"]["problem", "imdb"]["problem", "json"]["problem", "laplacian"]["problem", "monte carlo"]["problem", "raytrace"]["problem", "seismic"]["problem", "simplex"]["problem", "spellcheck"]["problem", "stockcorr"]["problem", "ziggurat"]["random", "collections"]["random", "randstring"]["random", "ranges"]["random", "sequences"]["random", "types"]["shootout"]["simd"]["sort", "insertionsort"]["sort", "issorted"]["sort", "mergesort"]["sort", "quicksort"]["sparse", "arithmetic"]["sparse", "constructors"]["sparse", "index"]["sparse", "matmul"]["sparse", "sparse matvec"]["sparse", "sparse solves"]["sparse", "transpose"]["string", "==(::AbstractString, ::AbstractString)"]["string", "==(::SubString, ::String)"]["string", "findfirst"]["string"]["string", "readuntil"]["string", "repeat"]["tuple", "index"]["tuple", "linear algebra"]["tuple", "misc"]["tuple", "reduction"]["union", "array"]
Julia Version 1.8.0-DEV.1335
Commit f912f69de3 (2022-01-14 15:38 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 20.04.3 LTS
uname: Linux 5.11.0-1022-aws #23~20.04.1-Ubuntu SMP Mon Nov 15 14:03:19 UTC 2021 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz:
speed user nice sys idle irq
#1 2999 MHz 148018 s 1692 s 93652 s 21935913 s 0 s
#2 3379 MHz 4439224 s 652 s 264435 s 17478284 s 0 s
#3 2999 MHz 108132 s 633 s 32265 s 22041095 s 0 s
#4 2999 MHz 97501 s 485 s 34704 s 22051725 s 0 s
#5 2999 MHz 99643 s 521 s 35857 s 22051144 s 0 s
#6 2999 MHz 71660 s 638 s 33520 s 22080192 s 0 s
#7 2999 MHz 64737 s 706 s 33358 s 22085348 s 0 s
#8 2999 MHz 62733 s 496 s 32482 s 22085592 s 0 s
Memory: 30.353321075439453 GB (7851.89453125 MB free)
Uptime: 2.21977895e6 sec
Load Avg: 1.0 1.0 1.07
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-13.0.0 (ORCJIT, skylake-avx512)
Julia Version 1.8.0-DEV.1316
Commit b57d2e17f7 (2022-01-14 15:38 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 20.04.3 LTS
uname: Linux 5.11.0-1022-aws #23~20.04.1-Ubuntu SMP Mon Nov 15 14:03:19 UTC 2021 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz:
speed user nice sys idle irq
#1 2999 MHz 149654 s 1719 s 95034 s 22030560 s 0 s
#2 3399 MHz 4530525 s 652 s 269438 s 17479806 s 0 s
#3 2999 MHz 108191 s 633 s 32284 s 22138839 s 0 s
#4 2999 MHz 97952 s 485 s 34722 s 22149082 s 0 s
#5 2999 MHz 100170 s 521 s 35888 s 22148410 s 0 s
#6 2999 MHz 71700 s 638 s 33533 s 22177964 s 0 s
#7 2999 MHz 64787 s 706 s 33374 s 22183106 s 0 s
#8 2999 MHz 62761 s 496 s 32499 s 22183366 s 0 s
Memory: 30.353321075439453 GB (8163.1484375 MB free)
Uptime: 2.22956152e6 sec
Load Avg: 1.28 1.14 1.05
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-13.0.0 (ORCJIT, skylake-avx512)