🚇 Retarget PR benchmarks to main

[s-weigand]

Since staging finally got merged into main 🎉 we can use main as the comparison standard for PR instead of the v0.4.0 release.

For the updated comment see.

Change summary

• 🚇 Use main and comparison for PRs
• 🚇 Compare main against last release (tag)

Checklist

• ✔️ Passing the tests (mandatory for all PR's)

[github-actions]

👈 Launch a binder notebook on branch s-weigand/pyglotaran/fix-pr-benchmark-target

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
No Duplication information

[github-actions]

Benchmark is done. Checkout the benchmark result page.
Benchmark differences below 5% might be due to CI noise.

Benchmark diff v0.4.1 vs. main

Parametrized benchmark signatures:

BenchmarkOptimize.time_optimize(index_dependent, grouped, weight)

All benchmarks:

       before           after         ratio
     [21ba272a]       [5c5e7a29]
     <v0.4.1>                   
-      46.6±0.2ms       31.7±0.2ms     0.68  BenchmarkOptimize.time_optimize(False, False, False)
-         285±1ms       37.5±0.8ms     0.13  BenchmarkOptimize.time_optimize(False, False, True)
-      64.2±0.3ms       52.4±0.1ms     0.82  BenchmarkOptimize.time_optimize(False, True, False)
-      65.8±0.4ms       56.0±0.6ms     0.85  BenchmarkOptimize.time_optimize(False, True, True)
-      46.7±0.2ms      40.8±0.05ms     0.87  BenchmarkOptimize.time_optimize(True, False, False)
-       286±0.6ms        59.8±50ms     0.21  BenchmarkOptimize.time_optimize(True, False, True)
       64.5±0.5ms       63.4±0.2ms     0.98  BenchmarkOptimize.time_optimize(True, True, False)
       66.3±0.2ms        67.4±40ms     1.02  BenchmarkOptimize.time_optimize(True, True, True)
             179M             182M     1.02  IntegrationTwoDatasets.peakmem_create_result
             197M             201M     1.02  IntegrationTwoDatasets.peakmem_optimize
-         202±2ms          165±2ms     0.82  IntegrationTwoDatasets.time_create_result
-      4.32±0.03s       1.47±0.08s     0.34  IntegrationTwoDatasets.time_optimize

Benchmark diff main vs. PR

Parametrized benchmark signatures:

BenchmarkOptimize.time_optimize(index_dependent, grouped, weight)

All benchmarks:

       before           after         ratio
     [2f1afe78]       [5c5e7a29]
      31.6±0.09ms       31.7±0.2ms     1.00  BenchmarkOptimize.time_optimize(False, False, False)
       37.1±0.3ms       37.5±0.8ms     1.01  BenchmarkOptimize.time_optimize(False, False, True)
       52.2±0.3ms       52.4±0.1ms     1.00  BenchmarkOptimize.time_optimize(False, True, False)
       55.6±0.6ms       56.0±0.6ms     1.01  BenchmarkOptimize.time_optimize(False, True, True)
       40.6±0.2ms      40.8±0.05ms     1.01  BenchmarkOptimize.time_optimize(True, False, False)
        88.6±50ms        59.8±50ms    ~0.68  BenchmarkOptimize.time_optimize(True, False, True)
       63.1±0.3ms       63.4±0.2ms     1.00  BenchmarkOptimize.time_optimize(True, True, False)
        69.6±40ms        67.4±40ms     0.97  BenchmarkOptimize.time_optimize(True, True, True)
             179M             182M     1.02  IntegrationTwoDatasets.peakmem_create_result
             197M             201M     1.02  IntegrationTwoDatasets.peakmem_optimize
          160±1ms          165±2ms     1.03  IntegrationTwoDatasets.time_create_result
       1.42±0.04s       1.47±0.08s     1.03  IntegrationTwoDatasets.time_optimize

[codecov]

Codecov Report

Merging #831 (5c5e7a2) into main (2f1afe7) will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##            main    #831   +/-   ##
=====================================
  Coverage   84.7%   84.7%           
=====================================
  Files         77      77           
  Lines       4343    4343           
  Branches     785     785           
=====================================
  Hits        3682    3682           
  Misses       521     521           
  Partials     140     140           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2f1afe7...5c5e7a2. Read the comment docs.

[jsnel]

Looks good.