Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid allocating new tracers #128

Merged
merged 2 commits into from
Jun 18, 2024
Merged

Avoid allocating new tracers #128

merged 2 commits into from
Jun 18, 2024

Conversation

adrhill
Copy link
Owner

@adrhill adrhill commented Jun 18, 2024

Some calls to "inner" overloads can be completely removed, which should avoid the allocation of new sets.

@adrhill adrhill added the run benchmark Run benchmarks in CI label Jun 18, 2024
@codecov-commenter
Copy link

codecov-commenter commented Jun 18, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 86.48%. Comparing base (16e7d44) to head (7faf599).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #128      +/-   ##
==========================================
- Coverage   86.48%   86.48%   -0.01%     
==========================================
  Files          31       31              
  Lines        1347     1332      -15     
==========================================
- Hits         1165     1152      -13     
+ Misses        182      180       -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmarks:
    • Target: 18 Jun 2024 - 19:03
    • Baseline: 18 Jun 2024 - 19:17
  • Package commits:
    • Target: 2896a4
    • Baseline: 16e7d4
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 1.18 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 1.11 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 0.94 (5%) ✅ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 1.07 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 1.07 (5%) ❌ 1.00 (1%)
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 1.06 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 1.10 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 1.07 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 1.08 (5%) ❌ 1.00 (1%)
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3185 MHz       7588 s          0 s        457 s      14872 s          0 s
       #2  2567 MHz       8746 s          0 s        609 s      13559 s          0 s
       #3  2445 MHz       5244 s          0 s        394 s      17276 s          0 s
       #4  3243 MHz       4253 s          0 s        381 s      18277 s          0 s
  Memory: 15.606502532958984 GB (13399.2734375 MB free)
  Uptime: 2297.54 sec
  Load Avg:  1.01  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2899 MHz       9885 s          0 s        608 s      21209 s          0 s
       #2  2707 MHz      10936 s          0 s        778 s      19989 s          0 s
       #3  2968 MHz       7708 s          0 s        540 s      23455 s          0 s
       #4  3243 MHz       5745 s          0 s        526 s      25426 s          0 s
  Memory: 15.606502532958984 GB (13345.453125 MB free)
  Uptime: 3177.87 sec
  Load Avg:  1.0  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 18 Jun 2024 - 19:3
  • Package commit: 2896a4
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.991 ms (5%) 67.95 MiB (1%) 106983
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.416 ms (5%) 4.950 ms 345.61 MiB (1%) 287593
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.188 ms (5%) 91.17 MiB (1%) 84379
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.307 ms (5%) 10.98 MiB (1%) 23267
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 493.796 ms (5%) 23.056 ms 1.16 GiB (1%) 792458
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 212.783 ms (5%) 7.462 ms 420.94 MiB (1%) 450196
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 137.568 ms (5%) 4.484 ms 251.04 MiB (1%) 721825
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.276 ms (5%) 12.22 MiB (1%) 16861
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 353.440 ms (5%) 20.743 ms 751.92 MiB (1%) 633996
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 229.769 ms (5%) 8.183 ms 384.46 MiB (1%) 691552
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 148.218 ms (5%) 8.097 ms 313.24 MiB (1%) 950306
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.731 ms (5%) 16.53 MiB (1%) 58225
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.562 ms (5%) 73.10 MiB (1%) 128837
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.002 ms (5%) 5.876 ms 380.60 MiB (1%) 316463
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 69.160 ms (5%) 1.856 ms 103.32 MiB (1%) 87011
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.139 ms (5%) 16.27 MiB (1%) 25540
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.443 ms (5%) 65.74 MiB (1%) 85074
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.551 ms (5%) 5.329 ms 342.18 MiB (1%) 218044
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.424 ms (5%) 1.655 ms 94.61 MiB (1%) 50506
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.555 ms (5%) 12.91 MiB (1%) 16998
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 47.009 ms (5%) 67.96 MiB (1%) 106984
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.487 ms (5%) 5.192 ms 345.76 MiB (1%) 287595
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 63.245 ms (5%) 94.29 MiB (1%) 84853
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.602 ms (5%) 12.29 MiB (1%) 24093
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 494.540 ms (5%) 22.743 ms 1.16 GiB (1%) 792459
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 213.887 ms (5%) 7.769 ms 421.08 MiB (1%) 450198
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 138.128 ms (5%) 4.575 ms 250.51 MiB (1%) 722061
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.982 ms (5%) 17.40 MiB (1%) 18054
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 352.705 ms (5%) 19.099 ms 751.92 MiB (1%) 633997
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 222.733 ms (5%) 7.882 ms 384.61 MiB (1%) 691554
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 150.520 ms (5%) 7.861 ms 320.38 MiB (1%) 957273
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.169 ms (5%) 18.62 MiB (1%) 59135
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.500 ms (5%) 73.11 MiB (1%) 128838
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 227.916 ms (5%) 5.818 ms 380.75 MiB (1%) 316465
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 69.562 ms (5%) 1.812 ms 103.41 MiB (1%) 87170
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.330 ms (5%) 15.92 MiB (1%) 26282
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.586 ms (5%) 65.75 MiB (1%) 85075
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 198.444 ms (5%) 5.074 ms 342.32 MiB (1%) 218046
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 60.540 ms (5%) 91.33 MiB (1%) 50350
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.771 ms (5%) 12.69 MiB (1%) 17669
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.537 ms (5%) 5.81 MiB (1%) 59356
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 143.738 μs (5%) 255.81 KiB (1%) 2855
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 956.495 μs (5%) 2.05 MiB (1%) 22268
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 52.037 μs (5%) 101.38 KiB (1%) 1182
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.437 s (5%) 938.709 ms 18.61 GiB (1%) 11476655
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 18.709 ms (5%) 63.25 MiB (1%) 414348
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.269 μs (5%) 15.42 KiB (1%) 149
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 283.069 μs (5%) 534.00 KiB (1%) 5909
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.873 ms (5%) 30.12 MiB (1%) 175241
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.086 ms (5%) 1.89 MiB (1%) 11061
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.547 ms (5%) 4.33 MiB (1%) 41515
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 218.048 μs (5%) 277.94 KiB (1%) 2621
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.142 s (5%) 76.217 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 36.461 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.474 μs (5%) 10.75 KiB (1%) 74
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 180.230 ms (5%) 5.275 ms 985.40 MiB (1%) 29691
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 53.137 ms (5%) 25.95 MiB (1%) 214417
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.336 ms (5%) 1.63 MiB (1%) 13517
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.432 ms (5%) 5.12 MiB (1%) 55344
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 204.232 μs (5%) 328.94 KiB (1%) 3490
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 12.523 s (5%) 1.624 s 10.21 GiB (1%) 50889199
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 385.197 ms (5%) 26.700 ms 384.42 MiB (1%) 1892002
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 13.666 μs (5%) 37.55 KiB (1%) 416
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 20.408 s (5%) 14.06 MiB (1%) 47846
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.576 ms (5%) 19.02 MiB (1%) 129169
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 657.680 μs (5%) 1.20 MiB (1%) 8189
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.152 ms (5%) 3.96 MiB (1%) 36910
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 115.306 μs (5%) 254.64 KiB (1%) 2336
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.684 s (5%) 323.719 ms 3.68 GiB (1%) 24650689
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 90.192 ms (5%) 5.989 ms 144.32 MiB (1%) 925914
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.663 μs (5%) 34.59 KiB (1%) 291
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.294 ms (5%) 8.59 MiB (1%) 25378
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.934 ms (5%) 4.21 MiB (1%) 22025
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 138.249 μs (5%) 277.56 KiB (1%) 1485
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 602.015 μs (5%) 1.24 MiB (1%) 9259
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 39.674 μs (5%) 80.50 KiB (1%) 605
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 674.628 ms (5%) 66.064 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 19.399 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.981 μs (5%) 10.98 KiB (1%) 77
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 573.351 μs (5%) 1.92 MiB (1%) 2919
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.581 ms (5%) 5.91 MiB (1%) 59360
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 146.504 μs (5%) 262.08 KiB (1%) 2857
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 968.790 μs (5%) 2.11 MiB (1%) 22273
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 53.851 μs (5%) 105.56 KiB (1%) 1185
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.362 s (5%) 911.763 ms 18.61 GiB (1%) 11476667
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 18.834 ms (5%) 63.37 MiB (1%) 414359
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 9.437 μs (5%) 26.52 KiB (1%) 169
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 282.237 μs (5%) 539.39 KiB (1%) 5851
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.648 ms (5%) 30.22 MiB (1%) 175245
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.081 ms (5%) 1.90 MiB (1%) 11063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.558 ms (5%) 4.39 MiB (1%) 41520
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 218.147 μs (5%) 282.12 KiB (1%) 2624
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.157 s (5%) 98.760 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 36.459 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.045 μs (5%) 21.17 KiB (1%) 94
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 170.017 ms (5%) 5.091 ms 810.98 MiB (1%) 29559
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 53.257 ms (5%) 26.04 MiB (1%) 214421
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.333 ms (5%) 1.64 MiB (1%) 13519
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.418 ms (5%) 5.18 MiB (1%) 55349
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 205.163 μs (5%) 333.12 KiB (1%) 3493
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 12.627 s (5%) 1.685 s 10.21 GiB (1%) 50889211
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 383.812 ms (5%) 28.389 ms 384.54 MiB (1%) 1892013
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.804 μs (5%) 43.16 KiB (1%) 392
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 20.684 s (5%) 8.69 MiB (1%) 38969
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.540 ms (5%) 19.12 MiB (1%) 129173
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 655.284 μs (5%) 1.20 MiB (1%) 8191
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.172 ms (5%) 4.02 MiB (1%) 36915
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 115.195 μs (5%) 258.83 KiB (1%) 2339
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.619 s (5%) 297.140 ms 3.69 GiB (1%) 24650701
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 89.363 ms (5%) 6.052 ms 144.43 MiB (1%) 925925
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.383 μs (5%) 42.75 KiB (1%) 287
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.120 ms (5%) 8.28 MiB (1%) 24580
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.970 ms (5%) 4.31 MiB (1%) 22029
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 141.134 μs (5%) 283.83 KiB (1%) 1487
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 640.114 μs (5%) 1.31 MiB (1%) 9264
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 42.019 μs (5%) 84.69 KiB (1%) 608
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 705.261 ms (5%) 71.196 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 20.483 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.422 μs (5%) 22.44 KiB (1%) 102
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 602.065 μs (5%) 2.00 MiB (1%) 3031
["OptimizationProblems", "britgas", "Hessian"] 5.014 ms (5%) 10.40 MiB (1%) 34698
["OptimizationProblems", "britgas", "Jacobian"] 306.293 μs (5%) 456.09 KiB (1%) 5668

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3185 MHz       7588 s          0 s        457 s      14872 s          0 s
       #2  2567 MHz       8746 s          0 s        609 s      13559 s          0 s
       #3  2445 MHz       5244 s          0 s        394 s      17276 s          0 s
       #4  3243 MHz       4253 s          0 s        381 s      18277 s          0 s
  Memory: 15.606502532958984 GB (13399.2734375 MB free)
  Uptime: 2297.54 sec
  Load Avg:  1.01  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

  • Time of benchmark: 18 Jun 2024 - 19:17
  • Package commit: 16e7d4
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.496 ms (5%) 67.95 MiB (1%) 106983
["Hessian", "Global", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 196.249 ms (5%) 5.864 ms 345.61 MiB (1%) 287593
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 62.576 ms (5%) 95.36 MiB (1%) 84670
["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.156 ms (5%) 10.80 MiB (1%) 23248
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 498.181 ms (5%) 27.076 ms 1.16 GiB (1%) 792458
["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 210.399 ms (5%) 6.749 ms 420.94 MiB (1%) 450196
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 138.734 ms (5%) 5.385 ms 250.95 MiB (1%) 715635
["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.925 ms (5%) 17.47 MiB (1%) 17398
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 345.736 ms (5%) 20.904 ms 751.92 MiB (1%) 633996
["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 235.054 ms (5%) 8.722 ms 384.46 MiB (1%) 691552
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 147.244 ms (5%) 8.293 ms 310.69 MiB (1%) 948472
["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.823 ms (5%) 17.00 MiB (1%) 58270
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 49.665 ms (5%) 73.10 MiB (1%) 128837
["Hessian", "Global", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 229.599 ms (5%) 8.287 ms 380.60 MiB (1%) 316463
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.975 ms (5%) 101.83 MiB (1%) 86821
["Hessian", "Global", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.495 ms (5%) 18.73 MiB (1%) 25723
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.140 ms (5%) 65.74 MiB (1%) 85074
["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 196.528 ms (5%) 5.356 ms 342.18 MiB (1%) 218044
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 61.470 ms (5%) 1.658 ms 92.61 MiB (1%) 50304
["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.589 ms (5%) 12.93 MiB (1%) 16993
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 46.682 ms (5%) 67.96 MiB (1%) 106984
["Hessian", "Local", ("BitSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 195.772 ms (5%) 4.141 ms 345.76 MiB (1%) 287595
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 65.849 ms (5%) 1.720 ms 98.88 MiB (1%) 85129
["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.665 ms (5%) 13.48 MiB (1%) 24172
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 498.400 ms (5%) 25.148 ms 1.16 GiB (1%) 792459
["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 210.611 ms (5%) 6.555 ms 421.08 MiB (1%) 450198
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 140.815 ms (5%) 5.426 ms 252.99 MiB (1%) 722241
["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.455 ms (5%) 14.03 MiB (1%) 17700
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 345.351 ms (5%) 21.046 ms 751.92 MiB (1%) 633997
["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 235.365 ms (5%) 8.813 ms 384.61 MiB (1%) 691554
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 150.901 ms (5%) 9.357 ms 314.84 MiB (1%) 950771
["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 6.743 ms (5%) 15.61 MiB (1%) 58862
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 50.223 ms (5%) 73.11 MiB (1%) 128838
["Hessian", "Local", ("Set", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 225.943 ms (5%) 6.119 ms 380.75 MiB (1%) 316465
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 67.010 ms (5%) 1.921 ms 96.94 MiB (1%) 86680
["Hessian", "Local", ("Set", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 7.569 ms (5%) 18.61 MiB (1%) 26425
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 200), :(K = 16))] 45.108 ms (5%) 65.75 MiB (1%) 85075
["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead", (:(N = 3200), :(K = 2))] 195.751 ms (5%) 4.880 ms 342.32 MiB (1%) 218046
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 100), :(K = 32))] 59.492 ms (5%) 90.48 MiB (1%) 50285
["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity", (:(N = 400), :(K = 2))] 5.605 ms (5%) 12.63 MiB (1%) 17662
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=24"] 2.543 ms (5%) 5.81 MiB (1%) 59356
["Jacobian", "Global", "BitSet", "Brusselator", "ODE", "N=6"] 143.659 μs (5%) 255.81 KiB (1%) 2855
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=24"] 948.752 μs (5%) 2.05 MiB (1%) 22268
["Jacobian", "Global", "BitSet", "Brusselator", "operator", "N=6"] 52.639 μs (5%) 101.38 KiB (1%) 1182
["Jacobian", "Global", "BitSet", "Conv", "size=128x128x3"] 2.065 s (5%) 316.405 ms 18.61 GiB (1%) 11476655
["Jacobian", "Global", "BitSet", "Conv", "size=28x28x3"] 18.544 ms (5%) 63.25 MiB (1%) 414348
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.757 μs (5%) 16.48 KiB (1%) 153
["Jacobian", "Global", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 275.675 μs (5%) 536.75 KiB (1%) 5953
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.308 ms (5%) 30.12 MiB (1%) 175241
["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.063 ms (5%) 1.89 MiB (1%) 11061
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.471 ms (5%) 4.33 MiB (1%) 41515
["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator", "N=6"] 212.827 μs (5%) 277.94 KiB (1%) 2621
["Jacobian", "Global", "DuplicateVector", "Conv", "size=128x128x3"] 1.094 s (5%) 56.056 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "DuplicateVector", "Conv", "size=28x28x3"] 36.486 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.783 μs (5%) 12.34 KiB (1%) 86
["Jacobian", "Global", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 160.477 ms (5%) 5.272 ms 877.80 MiB (1%) 29614
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=24"] 51.998 ms (5%) 25.95 MiB (1%) 214417
["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.275 ms (5%) 1.63 MiB (1%) 13517
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.360 ms (5%) 5.12 MiB (1%) 55344
["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator", "N=6"] 199.142 μs (5%) 328.94 KiB (1%) 3490
["Jacobian", "Global", "RecursiveSet", "Conv", "size=128x128x3"] 12.366 s (5%) 1.744 s 10.21 GiB (1%) 50889199
["Jacobian", "Global", "RecursiveSet", "Conv", "size=28x28x3"] 346.391 ms (5%) 18.795 ms 384.42 MiB (1%) 1892002
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.613 μs (5%) 36.62 KiB (1%) 409
["Jacobian", "Global", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 19.223 s (5%) 13.83 MiB (1%) 48721
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=24"] 11.278 ms (5%) 19.02 MiB (1%) 129169
["Jacobian", "Global", "Set", "Brusselator", "ODE", "N=6"] 638.953 μs (5%) 1.20 MiB (1%) 8189
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=24"] 2.136 ms (5%) 3.96 MiB (1%) 36910
["Jacobian", "Global", "Set", "Brusselator", "operator", "N=6"] 111.959 μs (5%) 254.64 KiB (1%) 2336
["Jacobian", "Global", "Set", "Conv", "size=128x128x3"] 2.862 s (5%) 527.232 ms 3.68 GiB (1%) 24650689
["Jacobian", "Global", "Set", "Conv", "size=28x28x3"] 89.418 ms (5%) 5.436 ms 144.32 MiB (1%) 925914
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 10.820 μs (5%) 31.53 KiB (1%) 265
["Jacobian", "Global", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.047 ms (5%) 8.29 MiB (1%) 24620
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=24"] 1.846 ms (5%) 4.21 MiB (1%) 22025
["Jacobian", "Global", "SortedVector", "Brusselator", "ODE", "N=6"] 131.957 μs (5%) 277.56 KiB (1%) 1485
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=24"] 563.322 μs (5%) 1.24 MiB (1%) 9259
["Jacobian", "Global", "SortedVector", "Brusselator", "operator", "N=6"] 36.929 μs (5%) 80.50 KiB (1%) 605
["Jacobian", "Global", "SortedVector", "Conv", "size=128x128x3"] 637.096 ms (5%) 77.883 ms 1.02 GiB (1%) 4662061
["Jacobian", "Global", "SortedVector", "Conv", "size=28x28x3"] 19.321 ms (5%) 41.58 MiB (1%) 175248
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 6.262 μs (5%) 10.98 KiB (1%) 77
["Jacobian", "Global", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 555.207 μs (5%) 1.95 MiB (1%) 2974
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=24"] 2.570 ms (5%) 5.91 MiB (1%) 59360
["Jacobian", "Local", "BitSet", "Brusselator", "ODE", "N=6"] 145.131 μs (5%) 262.08 KiB (1%) 2857
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=24"] 979.199 μs (5%) 2.11 MiB (1%) 22273
["Jacobian", "Local", "BitSet", "Brusselator", "operator", "N=6"] 53.690 μs (5%) 105.56 KiB (1%) 1185
["Jacobian", "Local", "BitSet", "Conv", "size=128x128x3"] 2.143 s (5%) 339.641 ms 18.61 GiB (1%) 11476667
["Jacobian", "Local", "BitSet", "Conv", "size=28x28x3"] 19.100 ms (5%) 63.37 MiB (1%) 414359
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.836 μs (5%) 24.94 KiB (1%) 157
["Jacobian", "Local", "BitSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 290.984 μs (5%) 546.39 KiB (1%) 5963
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=24"] 17.512 ms (5%) 30.22 MiB (1%) 175245
["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE", "N=6"] 1.077 ms (5%) 1.90 MiB (1%) 11063
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=24"] 3.499 ms (5%) 4.39 MiB (1%) 41520
["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator", "N=6"] 215.562 μs (5%) 282.12 KiB (1%) 2624
["Jacobian", "Local", "DuplicateVector", "Conv", "size=128x128x3"] 1.162 s (5%) 97.943 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "DuplicateVector", "Conv", "size=28x28x3"] 37.188 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 8.155 μs (5%) 22.81 KiB (1%) 107
["Jacobian", "Local", "DuplicateVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 163.660 ms (5%) 5.213 ms 901.37 MiB (1%) 29646
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=24"] 52.401 ms (5%) 26.04 MiB (1%) 214421
["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE", "N=6"] 3.303 ms (5%) 1.64 MiB (1%) 13519
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=24"] 3.400 ms (5%) 5.18 MiB (1%) 55349
["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator", "N=6"] 202.709 μs (5%) 333.12 KiB (1%) 3493
["Jacobian", "Local", "RecursiveSet", "Conv", "size=128x128x3"] 12.369 s (5%) 1.603 s 10.21 GiB (1%) 50889211
["Jacobian", "Local", "RecursiveSet", "Conv", "size=28x28x3"] 357.941 ms (5%) 22.623 ms 384.54 MiB (1%) 1892013
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.183 μs (5%) 43.03 KiB (1%) 388
["Jacobian", "Local", "RecursiveSet", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 21.527 s (5%) 9.50 MiB (1%) 40519
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=24"] 11.440 ms (5%) 19.12 MiB (1%) 129173
["Jacobian", "Local", "Set", "Brusselator", "ODE", "N=6"] 645.196 μs (5%) 1.20 MiB (1%) 8191
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=24"] 2.145 ms (5%) 4.02 MiB (1%) 36915
["Jacobian", "Local", "Set", "Brusselator", "operator", "N=6"] 116.238 μs (5%) 258.83 KiB (1%) 2339
["Jacobian", "Local", "Set", "Conv", "size=128x128x3"] 2.598 s (5%) 265.118 ms 3.69 GiB (1%) 24650701
["Jacobian", "Local", "Set", "Conv", "size=28x28x3"] 90.971 ms (5%) 6.494 ms 144.43 MiB (1%) 925925
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 12.483 μs (5%) 42.47 KiB (1%) 289
["Jacobian", "Local", "Set", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 4.277 ms (5%) 8.70 MiB (1%) 25755
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=24"] 1.898 ms (5%) 4.31 MiB (1%) 22029
["Jacobian", "Local", "SortedVector", "Brusselator", "ODE", "N=6"] 135.053 μs (5%) 283.83 KiB (1%) 1487
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=24"] 594.998 μs (5%) 1.31 MiB (1%) 9264
["Jacobian", "Local", "SortedVector", "Brusselator", "operator", "N=6"] 39.173 μs (5%) 84.69 KiB (1%) 608
["Jacobian", "Local", "SortedVector", "Conv", "size=128x128x3"] 674.104 ms (5%) 65.843 ms 1.02 GiB (1%) 4662073
["Jacobian", "Local", "SortedVector", "Conv", "size=28x28x3"] 19.749 ms (5%) 41.69 MiB (1%) 175259
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.01), :(depth = 5))] 7.243 μs (5%) 20.98 KiB (1%) 92
["Jacobian", "Local", "SortedVector", "SparseMul", (:(n = 50), :(p = 0.25), :(depth = 5))] 571.058 μs (5%) 1.97 MiB (1%) 3011
["OptimizationProblems", "britgas", "Hessian"] 5.032 ms (5%) 10.40 MiB (1%) 34698
["OptimizationProblems", "britgas", "Jacobian"] 317.493 μs (5%) 456.09 KiB (1%) 5668

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["Hessian", "Global", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Global", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("BitSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("BitSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("DuplicateVector", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("RecursiveSet", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("Set", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("Set", "Set"), "RandomSparsity"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "ArrowHead"]
  • ["Hessian", "Local", ("SortedVector", "Set"), "RandomSparsity"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "BitSet", "Conv"]
  • ["Jacobian", "Global", "BitSet", "SparseMul"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "DuplicateVector", "Conv"]
  • ["Jacobian", "Global", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Global", "RecursiveSet", "Conv"]
  • ["Jacobian", "Global", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Global", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Global", "Set", "Conv"]
  • ["Jacobian", "Global", "Set", "SparseMul"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Global", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Global", "SortedVector", "Conv"]
  • ["Jacobian", "Global", "SortedVector", "SparseMul"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "BitSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "BitSet", "Conv"]
  • ["Jacobian", "Local", "BitSet", "SparseMul"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "DuplicateVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "DuplicateVector", "Conv"]
  • ["Jacobian", "Local", "DuplicateVector", "SparseMul"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "RecursiveSet", "Brusselator", "operator"]
  • ["Jacobian", "Local", "RecursiveSet", "Conv"]
  • ["Jacobian", "Local", "RecursiveSet", "SparseMul"]
  • ["Jacobian", "Local", "Set", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "Set", "Brusselator", "operator"]
  • ["Jacobian", "Local", "Set", "Conv"]
  • ["Jacobian", "Local", "Set", "SparseMul"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "ODE"]
  • ["Jacobian", "Local", "SortedVector", "Brusselator", "operator"]
  • ["Jacobian", "Local", "SortedVector", "Conv"]
  • ["Jacobian", "Local", "SortedVector", "SparseMul"]
  • ["OptimizationProblems", "britgas"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2899 MHz       9885 s          0 s        608 s      21209 s          0 s
       #2  2707 MHz      10936 s          0 s        778 s      19989 s          0 s
       #3  2968 MHz       7708 s          0 s        540 s      23455 s          0 s
       #4  3243 MHz       5745 s          0 s        526 s      25426 s          0 s
  Memory: 15.606502532958984 GB (13345.453125 MB free)
  Uptime: 3177.87 sec
  Load Avg:  1.0  1.01  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@adrhill adrhill merged commit 9b78885 into main Jun 18, 2024
6 checks passed
@adrhill adrhill deleted the ah/skip-inner-1-to-1 branch June 18, 2024 21:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run benchmark Run benchmarks in CI
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants