[Perf] Windows/x86: 3 Regressions on 7/23/2023 2:51:47 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	d40ca00ca2fb5411ff159b2e84b800e8dfbd681e
Compare	65536eb2f01ebb85a54e792a2b974fe76af7e230
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in BilinearTest

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Interpol_Scalar - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	11.33 μs	13.49 μs	1.19	0.01	False	125727.26117886181	135994.11231884058	1.081659705649461)

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'BilinearTest*'

Payloads

Baseline
Compare

BilinearTest.Interpol_Scalar

ETL Files

Baseline
Compare

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.485161313657407 > 11.851489862573972.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 6/22/2023 7:55:14 AM, 7/14/2023 2:26:40 PM, 7/23/2023 4:13:29 AM, 7/31/2023 7:57:50 PM falls between 7/23/2023 4:13:29 AM and 7/31/2023 7:57:50 PM.
IsRegressionStdDev: Marked as regression because -120.53412848384517 (T) = (0 -13547.001104926449) / Math.Sqrt((3597.6314468768414 / (13)) + (2530.884630579332 / (31))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (13) + (31) - 2, .025) and -0.2025561972341714 = (11265.170921811372 - 13547.001104926449) / 11265.170921811372 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Baseline
Compare
Diff

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	d40ca00ca2fb5411ff159b2e84b800e8dfbd681e
Compare	65536eb2f01ebb85a54e792a2b974fe76af7e230
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.MathBenchmarks.Double

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
CosPi - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	85.80 μs	90.38 μs	1.05	0.10	False
Max - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	6.25 μs	16.95 μs	2.71	0.00	True	65716.16693679092	76881.13413304253	1.1698968110387606)

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.Double*'

Payloads

Baseline
Compare

System.MathBenchmarks.Double.CosPi

ETL Files

Baseline
Compare

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 90.37699421965316 > 90.05518160860656.
IsChangePoint: Marked as a change because one of 6/28/2023 2:04:56 PM, 7/23/2023 4:13:29 AM, 7/31/2023 7:57:50 PM falls between 7/23/2023 4:13:29 AM and 7/31/2023 7:57:50 PM.
IsRegressionStdDev: Marked as regression because -46.18007993602559 (T) = (0 -90308.85689451548) / Math.Sqrt((52519.93872508681 / (12)) + (166294.74857530493 / (31))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (12) + (31) - 2, .025) and -0.05315170841040571 = (85751.0424882896 - 90308.85689451548) / 85751.0424882896 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Baseline
Compare
Diff

System.MathBenchmarks.Double.Max

ETL Files

Baseline
Compare

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.950336677512656 > 6.566654586168936.
IsChangePoint: Marked as a change because one of 7/23/2023 4:13:29 AM, 7/31/2023 7:57:50 PM falls between 7/23/2023 4:13:29 AM and 7/31/2023 7:57:50 PM.
IsRegressionStdDev: Marked as regression because -1832.8027351129579 (T) = (0 -16965.170724684387) / Math.Sqrt((115.08024095136932 / (13)) + (783.0035049673639 / (31))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (13) + (31) - 2, .025) and -1.7097304713840331 = (6260.8332835476385 - 16965.170724684387) / 6260.8332835476385 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

Baseline
Compare
Diff

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository