[Perf] Windows/x86: 3 Improvements on 11/11/2022 10:59:41 PM

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	ce0b82ea7a19957ad3796e7e9a92e393bf6e30cc
Compare	43272d63c80f1cf6247fec62c2e189aa763f63a7
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IsMatch - Duration of single invocation	153.01 ms	73.71 ms	0.48	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Cache*'

Related Issues

Regressions

• [Perf] Windows/x86: 19 Regressions on 11/11/2022 10:59:41 PM
• [Perf] Windows/x64: 6 Regressions on 11/11/2022 10:59:41 PM
• [Perf] Alpine/x64: 2 Regressions on 11/11/2022 10:59:41 PM
• [Perf] Linux/x64: 1 Regression on 11/11/2022 10:59:41 PM

Improvements

• [Perf] Linux/x64: 1 Improvement on 11/11/2022 10:59:41 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 400000, unique: 7, cacheSize: 15)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 73.70911166666667 < 143.01667016666664.
IsChangePoint: Marked as a change because one of 9/2/2022 11:09:40 AM, 9/13/2022 12:23:36 PM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/6/2022 2:13:23 PM, 10/27/2022 12:34:03 AM, 11/11/2022 5:53:56 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsImprovementStdDev: Marked as improvement because 4.967014413075669 (T) = (0 -80861014.44444443) / Math.Sqrt((1541756880300517.8 / (299)) + (564649350823480.8 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.30740673766417026 = (116751084.4268594 - 80861014.44444443) / 116751084.4268594 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	ce0b82ea7a19957ad3796e7e9a92e393bf6e30cc
Compare	43272d63c80f1cf6247fec62c2e189aa763f63a7
Diff	Diff

Improvements in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WhereSingleOrDefault_LastElementMatches - Duration of single invocation	388.47 ns	325.87 ns	0.84	0.05	False
Select - Duration of single invocation	700.80 ns	642.27 ns	0.92	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Related Issues

Regressions

• [Perf] Windows/x86: 19 Regressions on 11/11/2022 10:59:41 PM
• [Perf] Windows/x64: 6 Regressions on 11/11/2022 10:59:41 PM
• [Perf] Alpine/x64: 2 Regressions on 11/11/2022 10:59:41 PM
• [Perf] Linux/x64: 1 Regression on 11/11/2022 10:59:41 PM

Improvements

• [Perf] Linux/x64: 1 Improvement on 11/11/2022 10:59:41 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: Array)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 325.8744380488215 < 367.3358431331357.
IsChangePoint: Marked as a change because one of 9/9/2022 3:12:19 AM, 9/15/2022 1:09:14 PM, 9/23/2022 1:16:35 AM, 10/2/2022 11:57:04 PM, 10/19/2022 7:27:15 PM, 10/26/2022 7:11:30 AM, 11/2/2022 4:14:20 AM, 11/11/2022 5:53:56 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsImprovementStdDev: Marked as improvement because 2.8517521821850353 (T) = (0 -335.9616657558567) / Math.Sqrt((944.3999764356018 / (299)) + (557.369646353238 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.056412008348474735 = (356.04699161954795 - 335.9616657558567) / 356.04699161954795 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.Select(input: Array)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 642.2687382219837 < 668.6518662337785.
IsChangePoint: Marked as a change because one of 9/26/2022 8:26:31 AM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/2/2022 4:14:20 AM, 11/11/2022 5:53:56 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsImprovementStdDev: Marked as improvement because 8.405517862617275 (T) = (0 -654.5726102077107) / Math.Sqrt((3008.6457316473147 / (299)) + (581.8315294978177 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08946637820120588 = (718.8890058936839 - 654.5726102077107) / 718.8890058936839 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository