Skip to content

Latest commit

 

History

History
458 lines (437 loc) · 32.5 KB

File metadata and controls

458 lines (437 loc) · 32.5 KB

Benchmark Report

Job Properties

Commits: JuliaLang/julia@9be47a44de38afbf48d83e0f7d0c0f189aa9149a vs JuliaLang/julia@54b92a74e3eaac068a6da3389bf078ccbc0622b8

Comparison Diff: link

Triggered By: link

Tag Predicate: ALL

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["array", "accumulate", ("cumsum!", "Float64", "dim1")] 1.05 (5%) ❌ 1.00 (1%)
["array", "accumulate", ("cumsum!", "Float64", "dim2")] 1.05 (5%) ❌ 1.00 (1%)
["array", "bool", "boolarray_bool_load!"] 0.94 (5%) ✅ 1.00 (1%)
["array", "cat", ("catnd", 5)] 0.88 (5%) ✅ 1.00 (1%)
["array", "equality", ("==", "UnitRange{Int64}")] 1.10 (5%) ❌ 1.00 (1%)
["array", "equality", ("==", "Vector{Int64} == UnitRange{Int64}")] 1.13 (5%) ❌ 1.00 (1%)
["array", "equality", ("isequal", "UnitRange{Int64}")] 0.82 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal UnitRange{Int64}")] 0.88 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Int64}")] 0.93 (5%) ✅ 1.00 (1%)
["array", "reductions", ("mean", "Float64")] 1.11 (5%) ❌ 1.00 (1%)
["array", "reductions", ("perf_reduce", "Int64")] 1.07 (5%) ❌ 1.00 (1%)
["array", "reductions", ("sum", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["array", "reductions", ("sumabs", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["array", "reductions", ("sumabs2", "Float64")] 1.13 (5%) ❌ 1.00 (1%)
["broadcast", "dotop", ("Float64", "(1000, 1000)", 2)] 1.12 (5%) ❌ 1.00 (1%)
["broadcast", "dotop", ("Float64", "(1000000,)", 2)] 0.89 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (10, "tup_tup")] 0.83 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (3, "scal_tup_x3")] 0.85 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "scal_tup")] 1.10 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "scal_tup_x3")] 1.09 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "tup_tup")] 0.91 (5%) ✅ 1.00 (1%)
["broadcast", "typeargs", ("array", 5)] 1.13 (5%) ❌ 1.00 (1%)
["collection", "deletion", ("Set", "Int", "filter!")] 0.51 (25%) ✅ 1.00 (1%)
["collection", "optimizations", ("Set", "concrete", "Nothing")] 0.72 (25%) ✅ 1.00 (1%)
["collection", "optimizations", ("Vector", "concrete", "Nothing")] 0.67 (25%) ✅ 1.00 (1%)
["dates", "accessor", "millisecond"] 0.92 (5%) ✅ 1.00 (1%)
["dates", "arithmetic", ("Date", "Day")] 1.11 (5%) ❌ 1.00 (1%)
["dates", "arithmetic", ("DateTime", "Day")] 1.10 (5%) ❌ 1.00 (1%)
["dates", "arithmetic", ("DateTime", "Hour")] 0.89 (5%) ✅ 1.00 (1%)
["dates", "arithmetic", ("DateTime", "Millisecond")] 0.90 (5%) ✅ 1.00 (1%)
["dates", "arithmetic", ("DateTime", "Minute")] 0.90 (5%) ✅ 1.00 (1%)
["dates", "arithmetic", ("DateTime", "Second")] 0.90 (5%) ✅ 1.00 (1%)
["dates", "conversion", "Date -> DateTime"] 0.90 (5%) ✅ 1.00 (1%)
["dates", "conversion", "DateTime -> Date"] 0.84 (5%) ✅ 1.00 (1%)
["dates", "parse", "DateTime"] 1.05 (5%) ❌ 1.00 (1%)
["dates", "parse", ("DateTime", "ISODateTimeFormat")] 0.81 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Float32}")] 1.10 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{UInt8}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{UInt8}")] 0.95 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{Bool}")] 0.89 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{Float64}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float32}")] 1.12 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float64}")] 1.08 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Int64}")] 1.06 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{UInt64}")] 1.14 (5%) ❌ 1.00 (1%)
["find", "findall", ("ispos", "Vector{UInt8}")] 1.09 (5%) ❌ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{Bool}")] 1.14 (5%) ❌ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{Int64}")] 1.14 (5%) ❌ 1.00 (1%)
["micro", "fib"] 0.87 (5%) ✅ 1.00 (1%)
["misc", "23042", "ComplexF32"] 1.09 (5%) ❌ 1.00 (1%)
["misc", "23042", "Float64"] 1.45 (5%) ❌ 1.00 (1%)
["misc", "bitshift", ("UInt", "UInt")] 0.92 (5%) ✅ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...))"] 1.14 (5%) ❌ 1.00 (1%)
["misc", "iterators", "zip(1:1, 1:1, 1:1, 1:1)"] 1.22 (5%) ❌ 1.00 (1%)
["problem", "simplex", "simplex"] 0.92 (5%) ✅ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "Bool")] 1.27 (25%) ❌ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "Int32")] 1.27 (25%) ❌ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "Int64")] 1.32 (25%) ❌ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "Int8")] 1.26 (25%) ❌ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "UInt16")] 1.27 (25%) ❌ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "UInt64")] 0.74 (25%) ✅ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "UInt8")] 1.27 (25%) ❌ 1.00 (1%)
["scalar", "acos", ("0.5 <= abs(x) < 1", "negative argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "negative argument", "Float32")] 0.52 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "positive argument", "Float32")] 0.52 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("one", "negative argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("one", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("one", "positive argument", "Float64")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("small", "negative argument", "Float32")] 0.53 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("small", "positive argument", "Float32")] 0.49 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("zero", "Float32")] 0.51 (5%) ✅ 1.00 (1%)
["scalar", "acosh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 0.77 (5%) ✅ 1.00 (1%)
["scalar", "acosh", ("one", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "acosh", ("very large", "positive argument", "Float32")] 0.64 (5%) ✅ 1.00 (1%)
["scalar", "arithmetic", ("div", "ComplexF32", "ComplexF64")] 1.63 (50%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("div", "ComplexF64", "ComplexF32")] 1.66 (50%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("div", "ComplexF64", "ComplexF64")] 1.66 (25%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("div", "Complex{UInt64}", "ComplexF64")] 1.53 (50%) ❌ 1.00 (1%)
["scalar", "asin", ("0.5 <= abs(x) < 0.975", "negative argument", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("0.975 <= abs(x) < 1.0", "positive argument", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "negative argument", "Float32")] 0.54 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "positive argument", "Float32")] 0.54 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("small", "negative argument", "Float32")] 0.56 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("small", "positive argument", "Float32")] 0.55 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("zero", "Float32")] 0.55 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "negative argument", "Float32")] 0.66 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "negative argument", "Float64")] 0.76 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "positive argument", "Float32")] 0.66 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "positive argument", "Float64")] 0.76 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "negative argument", "Float32")] 0.75 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "negative argument", "Float64")] 0.76 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 0.75 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float64")] 0.76 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2^-28 <= abs(x) < 2", "negative argument", "Float32")] 0.77 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2^-28 <= abs(x) < 2", "negative argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2^-28 <= abs(x) < 2", "positive argument", "Float32")] 0.77 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2^-28 <= abs(x) < 2", "positive argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("very large", "negative argument", "Float32")] 0.73 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("very large", "positive argument", "Float32")] 0.73 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("very small", "negative argument", "Float32")] 0.49 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("very small", "positive argument", "Float32")] 0.47 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("zero", "Float32")] 0.49 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("0 <= abs(x) < 7/16", "negative argument", "Float32")] 0.36 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("0 <= abs(x) < 7/16", "positive argument", "Float32")] 0.36 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "negative argument", "Float32")] 0.57 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "positive argument", "Float32")] 0.57 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("19/16 <= abs(x) < 39/16", "negative argument", "Float32")] 0.61 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("19/16 <= abs(x) < 39/16", "positive argument", "Float32")] 0.61 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "negative argument", "Float32")] 0.59 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "positive argument", "Float32")] 0.59 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "negative argument", "Float32")] 0.58 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "positive argument", "Float32")] 0.58 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "negative argument", "Float32")] 0.47 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "negative argument", "Float64")] 0.87 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "positive argument", "Float32")] 0.49 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "positive argument", "Float64")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float32")] 0.33 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "positive argument", "Float32")] 0.33 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "positive argument", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("zero", "Float32")] 0.33 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("zero", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y negative", "x positive", "Float32")] 0.59 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y positive", "x positive", "Float32")] 0.58 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y negative", "x negative", "Float32")] 0.71 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y negative", "x positive", "Float32")] 0.70 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y positive", "x negative", "Float32")] 0.71 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y positive", "x positive", "Float32")] 0.70 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y negative", "x negative", "Float32")] 0.72 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y negative", "x positive", "Float32")] 0.72 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y positive", "x negative", "Float32")] 0.70 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y positive", "x positive", "Float32")] 0.71 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x positive", "Float32")] 0.44 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x positive", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("x one", "Float32")] 0.44 (5%) ✅ 1.00 (1%)
["scalar", "atanh", ("0.5 <= abs(x) < 1", "negative argument", "Float32")] 1.14 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("0.5 <= abs(x) < 1", "positive argument", "Float32")] 1.14 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("2^-28 <= abs(x) < 0.5", "negative argument", "Float32")] 1.13 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("2^-28 <= abs(x) < 0.5", "positive argument", "Float32")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("very small", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "cbrt", ("zero", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float32", "cos_kernel")] 0.62 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "positive argument", "Float32", "cos_kernel")] 0.62 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 6π/4", "positive argument", "Float32", "sin_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 6π/4", "positive argument", "Float64", "sin_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 7π/4", "positive argument", "Float32", "cos_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 7π/4", "positive argument", "Float64", "cos_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "negative argument", "Float32", "cos_kernel")] 0.86 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "positive argument", "Float32", "cos_kernel")] 0.87 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float64")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "exp2", ("2pow127", "negative argument", "Float32")] 0.47 (5%) ✅ 1.00 (1%)
["scalar", "iteration", "indexed"] 0.70 (25%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float32", "sin_kernel")] 0.63 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2.0^20π/4", "positive argument", "Float32", "sin_kernel")] 0.63 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2π/4", "positive argument", "Float32", "cos_kernel")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 3π/4", "positive argument", "Float32", "cos_kernel")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (hard) abs(x) < 2π/4", "positive argument", "Float32", "cos_kernel")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "negative argument", "Float32", "sin_kernel")] 0.83 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "negative argument", "Float64", "cos_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "positive argument", "Float32", "sin_kernel")] 0.83 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (paynehanek) abs(x) > 2.0^20*π/2", "positive argument", "Float64", "cos_kernel")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "zero", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "zero", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float32")] 0.65 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "positive argument", "Float32")] 0.66 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (easy) abs(x) < 4π/4", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (hard) abs(x) < 4π/4", "negative argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "sincos", ("argument reduction (hard) abs(x) < 4π/4", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "sinh", ("0 <= abs(x) < 2f-12", "negative argument", "Float32")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("0 <= abs(x) < 2f-12", "positive argument", "Float32")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("medium", "negative argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("medium", "positive argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("small", "negative argument", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("small", "positive argument", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("very small", "negative argument", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("very small", "negative argument", "Float64")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("very small", "positive argument", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("zero", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("zero", "Float64")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("0 <= abs(x) < 2f0^-12", "negative argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "tanh", ("2f0^-12 <= abs(x) < 1f0", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "tanh", ("very large", "negative argument", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("very large", "positive argument", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "tanh", ("very large", "positive argument", "Float64")] 0.89 (5%) ✅ 1.00 (1%)
["simd", ("Cartesian", "axpy!", "Float32", 3, 31)] 1.26 (20%) ❌ 1.00 (1%)
["sparse", "constructors", ("Diagonal", 1000)] 1.06 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("IJV", 100)] 1.07 (5%) ❌ 1.00 (1%)
["sparse", "matmul", ("Ac_mul_B", "dense 50x5, sparse 50x500 -> dense 5x500")] 1.33 (30%) ❌ 1.00 (1%)
["sparse", "matmul", ("Ac_mul_Bc!", "dense 20x2000, sparse 20x20 -> dense 2000x20")] 1.37 (30%) ❌ 1.00 (1%)
["string", "==(::AbstractString, ::AbstractString)", "different"] 0.88 (5%) ✅ 1.00 (1%)
["string", "==(::SubString, ::String)", "different length"] 0.91 (5%) ✅ 1.00 (1%)
["string", "readuntil", "target length 1000"] 1.11 (5%) ❌ 1.00 (1%)
["string", "readuntil", "target length 50000"] 1.11 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matmat", "(16, 16)", "(16, 16)")] 1.83 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(16, 16)", "(16,)")] 0.73 (5%) ✅ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(4, 4)", "(4,)")] 1.17 (5%) ❌ 1.00 (1%)
["tuple", "linear algebra", ("matvec", "(8, 8)", "(8,)")] 0.80 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sum", "(8,)")] 0.91 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(4,)")] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(false, false)")] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(true, true)")] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "BigFloat", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Bool", 1)] 1.18 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int64", 0)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int64", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "identity", "BigFloat", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "Int8", 0)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "BigFloat", 0)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "BigInt", "(false, false)")] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "abs", "Bool", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "abs", "Int8", 1)] 0.79 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "BigFloat", 0)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "BigInt")] 0.87 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Int64")] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigFloat", 0)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_simplecopy", "Int8", 1)] 0.79 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum", "BigInt", 0)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum", "Float64", 1)] 1.16 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum2", "BigInt", 0)] 0.95 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "Float32", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "Float64", 1)] 0.74 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "BigInt", 0)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "Bool", 0)] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Float32", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "Int8", 0)] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "keys", "Union{Missing, Int8}", 1)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "BigInt", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Int64", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Nothing, BigInt}", 0)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Bool", 0)] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["alloc"]
  • ["array", "accumulate"]
  • ["array", "any/all"]
  • ["array", "bool"]
  • ["array", "cat"]
  • ["array", "comprehension"]
  • ["array", "convert"]
  • ["array", "equality"]
  • ["array", "growth"]
  • ["array", "index"]
  • ["array", "reductions"]
  • ["array", "reverse"]
  • ["array", "setindex!"]
  • ["array", "subarray"]
  • ["broadcast"]
  • ["broadcast", "dotop"]
  • ["broadcast", "fusion"]
  • ["broadcast", "mix_scalar_tuple"]
  • ["broadcast", "sparse"]
  • ["broadcast", "typeargs"]
  • ["collection", "deletion"]
  • ["collection", "initialization"]
  • ["collection", "iteration"]
  • ["collection", "optimizations"]
  • ["collection", "queries & updates"]
  • ["collection", "set operations"]
  • ["dates", "accessor"]
  • ["dates", "arithmetic"]
  • ["dates", "construction"]
  • ["dates", "conversion"]
  • ["dates", "parse"]
  • ["dates", "query"]
  • ["dates", "string"]
  • ["find", "findall"]
  • ["find", "findnext"]
  • ["find", "findprev"]
  • ["frontend"]
  • ["inference", "abstract interpretation"]
  • ["inference"]
  • ["inference", "optimization"]
  • ["io", "array_limit"]
  • ["io", "read"]
  • ["io", "serialization"]
  • ["io"]
  • ["linalg", "arithmetic"]
  • ["linalg", "blas"]
  • ["linalg", "factorization"]
  • ["linalg"]
  • ["micro"]
  • ["misc"]
  • ["misc", "23042"]
  • ["misc", "afoldl"]
  • ["misc", "allocation elision view"]
  • ["misc", "bitshift"]
  • ["misc", "foldl"]
  • ["misc", "issue 12165"]
  • ["misc", "iterators"]
  • ["misc", "julia"]
  • ["misc", "parse"]
  • ["misc", "repeat"]
  • ["misc", "splatting"]
  • ["problem", "chaosgame"]
  • ["problem", "fem"]
  • ["problem", "go"]
  • ["problem", "grigoriadis khachiyan"]
  • ["problem", "imdb"]
  • ["problem", "json"]
  • ["problem", "laplacian"]
  • ["problem", "monte carlo"]
  • ["problem", "raytrace"]
  • ["problem", "seismic"]
  • ["problem", "simplex"]
  • ["problem", "spellcheck"]
  • ["problem", "stockcorr"]
  • ["problem", "ziggurat"]
  • ["random", "collections"]
  • ["random", "randstring"]
  • ["random", "ranges"]
  • ["random", "sequences"]
  • ["random", "types"]
  • ["scalar", "acos"]
  • ["scalar", "acosh"]
  • ["scalar", "arithmetic"]
  • ["scalar", "asin"]
  • ["scalar", "asinh"]
  • ["scalar", "atan"]
  • ["scalar", "atan2"]
  • ["scalar", "atanh"]
  • ["scalar", "cbrt"]
  • ["scalar", "cos"]
  • ["scalar", "cosh"]
  • ["scalar", "exp2"]
  • ["scalar", "expm1"]
  • ["scalar", "fastmath"]
  • ["scalar", "floatexp"]
  • ["scalar", "intfuncs"]
  • ["scalar", "iteration"]
  • ["scalar", "mod2pi"]
  • ["scalar", "predicate"]
  • ["scalar", "rem_pio2"]
  • ["scalar", "sin"]
  • ["scalar", "sincos"]
  • ["scalar", "sinh"]
  • ["scalar", "tan"]
  • ["scalar", "tanh"]
  • ["shootout"]
  • ["simd"]
  • ["sort", "insertionsort"]
  • ["sort", "issorted"]
  • ["sort", "mergesort"]
  • ["sort", "quicksort"]
  • ["sparse", "arithmetic"]
  • ["sparse", "constructors"]
  • ["sparse", "index"]
  • ["sparse", "matmul"]
  • ["sparse", "sparse matvec"]
  • ["sparse", "sparse solves"]
  • ["sparse", "transpose"]
  • ["string", "==(::AbstractString, ::AbstractString)"]
  • ["string", "==(::SubString, ::String)"]
  • ["string", "findfirst"]
  • ["string"]
  • ["string", "readuntil"]
  • ["string", "repeat"]
  • ["tuple", "index"]
  • ["tuple", "linear algebra"]
  • ["tuple", "misc"]
  • ["tuple", "reduction"]
  • ["union", "array"]

Version Info

Primary Build

Julia Version 1.9.0-DEV.717
Commit 9be47a44de (2022-06-08 08:57 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.4 LTS
  uname: Linux 5.4.0-113-generic #127-Ubuntu SMP Wed May 18 14:30:56 UTC 2022 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3043 MHz      21950 s         64 s       7194 s   12842467 s          0 s
       #2  2995 MHz     703832 s          4 s      36140 s   12132856 s          0 s
       #3  3120 MHz      23556 s         15 s       5972 s   12837210 s          0 s
       #4  2974 MHz      18136 s         44 s       5836 s   12838945 s          0 s
       #5  2952 MHz      19635 s         32 s       5958 s   12800626 s          0 s
       #6  3132 MHz      19621 s         16 s       5820 s   12841801 s          0 s
       #7  3077 MHz      19878 s         14 s       6028 s   12846413 s          0 s
       #8  3055 MHz      22351 s         33 s       5919 s   12840989 s          0 s
  Memory: 31.32082748413086 GB (20223.73046875 MB free)
  Uptime: 1.28832391e6 sec
  Load Avg:  1.0  1.04  1.01
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, haswell)
  Threads: 1 on 8 virtual cores

Comparison Build

Julia Version 1.9.0-DEV.713
Commit 54b92a74e3 (2022-06-08 07:32 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.4 LTS
  uname: Linux 5.4.0-113-generic #127-Ubuntu SMP Wed May 18 14:30:56 UTC 2022 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz: 
              speed         user         nice          sys         idle          irq
       #1  3107 MHz      22464 s         80 s       7392 s   12969279 s          0 s
       #2  3029 MHz     824016 s          4 s      41518 s   12135058 s          0 s
       #3  3268 MHz      24170 s         15 s       5992 s   12964312 s          0 s
       #4  2962 MHz      18171 s         44 s       5845 s   12966550 s          0 s
       #5  2879 MHz      20061 s         32 s       5975 s   12927789 s          0 s
       #6  3139 MHz      19706 s         16 s       5829 s   12969464 s          0 s
       #7  3331 MHz      20209 s         14 s       6042 s   12973824 s          0 s
       #8  3164 MHz      22723 s         33 s       5937 s   12968354 s          0 s
  Memory: 31.32082748413086 GB (19222.48046875 MB free)
  Uptime: 1.30110047e6 sec
  Load Avg:  1.0  1.03  1.01
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, haswell)
  Threads: 1 on 8 virtual cores