[Perf] Linux/x64: 2 Regressions on 11/3/2022 9:01:15 AM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	13d4e6de2c4ecd1414bd29d5240fb6fe2e33b9fa
Compare	a20b31ab0c8b9b0aad8fbf72d1c5e91a2095adf0
Diff	Diff

Regressions in System.Tests.Perf_Environment

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetFolderPath - Duration of single invocation	4.58 μs	5.67 μs	1.24	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Environment*'

Related Issues

Regressions

• [Perf] Windows/x64: 1 Regression on 11/3/2022 9:01:15 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Environment.GetFolderPath(folder: System, option: None)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 5.6699730155809105 > 4.821934448639857.
IsChangePoint: Marked as a change because one of 11/2/2022 9:17:08 PM, 11/8/2022 6:56:37 AM falls between 10/30/2022 5:36:44 PM and 11/8/2022 6:56:37 AM.
IsRegressionStdDev: Marked as regression because -37.98366209069593 (T) = (0 -5571.687878548209) / Math.Sqrt((1202.5511829164038 / (26)) + (6819.0056049704945 / (11))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (11) - 2, .025) and -0.21352490369352953 = (4591.3255357100725 - 5571.687878548209) / 4591.3255357100725 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	13d4e6de2c4ecd1414bd29d5240fb6fe2e33b9fa
Compare	a20b31ab0c8b9b0aad8fbf72d1c5e91a2095adf0
Diff	Diff

Regressions in System.Tests.Perf_Enum

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Parse - Duration of single invocation	2.25 μs	2.63 μs	1.17	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Enum*'

Related Issues

Regressions

• [Perf] Windows/x64: 1 Regression on 11/3/2022 9:01:15 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Enum.Parse(text: "Red")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 2.625243535293112 > 2.360717356686081.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 11/2/2022 9:17:08 PM, 11/8/2022 6:56:37 AM falls between 10/30/2022 5:36:44 PM and 11/8/2022 6:56:37 AM.
IsRegressionStdDev: Marked as regression because -16.433989173166392 (T) = (0 -2643.367960583954) / Math.Sqrt((1487.4992792479065 / (26)) + (6114.9802533760285 / (12))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (12) - 2, .025) and -0.17372580967055343 = (2252.1170948144236 - 2643.367960583954) / 2252.1170948144236 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

Looks like dotnet/runtime#77763. @vargaz is the regression expected? can we do anything about it?