[Perf] Windows/x86: 8 Regressions on 10/17/2022 8:10:07 PM

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
DotBenchmark - Duration of single invocation	0.35 ns	35.54 ns	101.85	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int64>*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Int64>.DotBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 35.538281572999125 > 0.6008415672005469.
IsChangePoint: Marked as a change because one of 10/11/2022 5:13:36 PM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -11.406468153113112 (T) = (0 -35.56299984110841) / Math.Sqrt((120.90338043821053 / (17)) + (1.7616099507026206 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -6.098861786900201 = (5.009676326806948 - 35.56299984110841) / 5.009676326806948 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetConverter - Duration of single invocation	135.11 ns	145.71 ns	1.08	0.02	False
GetConverter - Duration of single invocation	133.57 ns	145.30 ns	1.09	0.01	False
GetConverter - Duration of single invocation	112.33 ns	120.98 ns	1.08	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.ComponentModel.Tests.Perf_TypeDescriptorTests*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassIDerived))

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 145.70909401606167 > 141.8720748141366.
IsChangePoint: Marked as a change because one of 8/27/2022 12:34:40 AM, 9/9/2022 3:12:19 AM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -42.70620747592269 (T) = (0 -144.7523127444306) / Math.Sqrt((0.3646787127708673 / (17)) + (0.7389403116854022 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.06898312901712268 = (135.41122288573743 - 144.7523127444306) / 135.41122288573743 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(string))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 145.30260952836963 > 140.18334715152966.
IsChangePoint: Marked as a change because one of 8/17/2022 2:33:27 AM, 10/11/2022 5:13:36 PM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -41.92484140254375 (T) = (0 -144.06982918897234) / Math.Sqrt((0.6699368990984612 / (17)) + (0.5412041998530829 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.07587810998223114 = (133.90906260872967 - 144.06982918897234) / 133.90906260872967 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.IDerived))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 120.97788794902249 > 118.06799449248311.
IsChangePoint: Marked as a change because one of 9/22/2022 3:11:11 PM, 10/11/2022 5:13:36 PM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -28.863711054075928 (T) = (0 -120.81642580137772) / Math.Sqrt((1.085475435368442 / (17)) + (0.2994048895015232 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.0697795837732688 = (112.93581185690658 - 120.81642580137772) / 112.93581185690658 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in System.IO.Tests.Perf_RandomAccess

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteAsync - Duration of single invocation	114.70 ms	137.64 ms	1.20	0.21	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_RandomAccess*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.IO.Tests.Perf_RandomAccess.WriteAsync(fileSize: 104857600, bufferSize: 16384, options: Asynchronous)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 137.63553214285713 > 116.1917085.
IsChangePoint: Marked as a change because one of 8/13/2022 2:59:44 AM, 9/2/2022 3:08:54 AM, 9/13/2022 12:23:36 PM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -12.966205525466325 (T) = (0 -133834365.87714092) / Math.Sqrt((6266285986196.053 / (17)) + (82620799758316.36 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.2143452244193119 = (110211135.33932595 - 133834365.87714092) / 110211135.33932595 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in LinqBenchmarks

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Where00LinqMethodX - Duration of single invocation	621.50 ms	661.97 ms	1.07	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'LinqBenchmarks*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

LinqBenchmarks.Where00LinqMethodX

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 661.9667133333334 > 649.7868807499999.
IsChangePoint: Marked as a change because one of 9/16/2022 6:13:21 PM, 9/20/2022 2:28:44 AM, 9/27/2022 11:22:50 AM, 10/6/2022 10:14:50 PM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -54.444720496956826 (T) = (0 -677314010.2511772) / Math.Sqrt((5779815820607.6875 / (17)) + (22664068313833.45 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.09430708777177498 = (618943272.7063133 - 677314010.2511772) / 618943272.7063133 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in System.IO.Tests.Perf_FileStream

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteAsync_NoBuffering_PreallocationSize - Duration of single invocation	100.28 ms	134.56 ms	1.34	0.21	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_FileStream*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.IO.Tests.Perf_FileStream.WriteAsync_NoBuffering_PreallocationSize(fileSize: 104857600, userBufferSize: 16384, options: Asynchronous)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 134.55548666666667 > 109.176996.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -16.03674992229245 (T) = (0 -134070106.14418364) / Math.Sqrt((5628626299099.29 / (17)) + (93570194010487.38 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.29741883034342087 = (103336026.12249422 - 134070106.14418364) / 103336026.12249422 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in System.Tests.Perf_Array

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ArrayCopy2D - Duration of single invocation	244.01 ns	332.87 ns	1.36	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Array*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Array.ArrayCopy2D

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 332.87399952919014 > 264.5675739006176.
IsChangePoint: Marked as a change because one of 10/11/2022 5:13:36 PM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -46.161767149753324 (T) = (0 -339.78529030683507) / Math.Sqrt((44.83215522367959 / (17)) + (35.866524279551314 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.3678327930845326 = (248.4114228176983 - 339.78529030683507) / 248.4114228176983 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository