add benchmark GHA

[palday]

No description provided.

[codecov]

Codecov Report

Patch and project coverage have no change.

Comparison is base (df203bc) 95.83% compared to head (7c429bc) 95.83%.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #710   +/-   ##
=======================================
  Coverage   95.83%   95.83%           
=======================================
  Files          35       35           
  Lines        3267     3267           
=======================================
  Hits         3131     3131           
  Misses        136      136           

Flag	Coverage Δ
current	95.83% <ø> (ø)
minimum	95.73% <ø> (ø)
nightly	95.83% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[dmbates]

I think many of simple scalar benchmarks are unnecessary because they take so little time. They can show large relative differences because the denominator is so small. We may want to just run the crossed vector benchmarks.

[github-actions]

Benchmark Report for /home/runner/work/MixedModels.jl/MixedModels.jl

Job Properties

• Time of benchmarks:
  • Target: 22 Aug 2023 - 22:53
  • Baseline: 22 Aug 2023 - 22:59
• Package commits:
  • Target: 39b884
  • Baseline: df203b
• Julia commits:
  • Target: e4ee48
  • Baseline: e4ee48
• Julia command flags:
  • Target: None
  • Baseline: -Cnative,-J/opt/hostedtoolcache/julia/1.9.2/x64/lib/julia/sys.so,-g1,-O3,-e,using Pkg; Pkg.update(); Pkg.add(["BenchmarkTools", "StatsModels"])
• Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["crossed", "ml1m:1"]	0.92 (5%) ✅	0.81 (1%) ✅
["crossed", "mrk17_exp1:1"]	0.01 (5%) ✅	0.18 (1%) ✅
["crossed", "penicillin:1"]	0.94 (5%) ✅	1.00 (1%)
["crossedvector", "d3:1"]	0.83 (5%) ✅	0.55 (1%) ✅
["crossedvector", "mrk17_exp1:2"]	0.91 (5%) ✅	0.64 (1%) ✅
["nested", "pastes:2"]	0.00 (5%) ✅	0.00 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["crossed"]
• ["crossedvector"]
• ["nested"]
• ["singlevector"]

Julia versioninfo

Target

Julia Version 1.9.2
Commit e4ee485e909 (2023-07-05 09:39 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.3 LTS
  uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz       5578 s          0 s        212 s       1175 s          0 s
       #2  2095 MHz       2166 s          0 s        316 s       4459 s          0 s
  Memory: 6.7694854736328125 GB (4858.6640625 MB free)
  Uptime: 704.19 sec
  Load Avg:  1.0  1.07  0.77
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-14.0.6 (ORCJIT, skylake-avx512)
  Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.9.2
Commit e4ee485e909 (2023-07-05 09:39 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.3 LTS
  uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz       8785 s          0 s        322 s       1559 s          0 s
       #2  2095 MHz       3990 s          0 s        432 s       6214 s          0 s
  Memory: 6.7694854736328125 GB (4936.64453125 MB free)
  Uptime: 1074.61 sec
  Load Avg:  1.09  1.42  1.09
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-14.0.6 (ORCJIT, skylake-avx512)
  Threads: 1 on 2 virtual cores