[Perf] Changes at 4/6/2022 2:58:43 AM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	009d9cfedd8ebf5649e59633062229c6c5d6f1d0
Compare	74f58586d6165e4c8c7a33fde2030024d502bf7c
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Date_IsMatch - Duration of single invocation	290.89 ns	244.30 ns	0.84	0.28	False
MatchesSet - Duration of single invocation	193.80 μs	94.17 μs	0.49	0.43	False
Date_IsNotMatch - Duration of single invocation	449.91 ns	303.55 ns	0.67	0.35	False
Uri_IsMatch - Duration of single invocation	438.71 ns	394.35 ns	0.90	0.48	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsMatch(Options: IgnoreCase, Compiled)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 244.29880240248852 < 274.06035289558605.
IsChangePoint: Marked as a change because one of 1/26/2022 3:32:45 AM, 4/6/2022 12:51:22 AM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsImprovementStdDev: Marked as improvement because 44.94086810514637 (T) = (0 -244.8947397739239) / Math.Sqrt((168.97754881906926 / (270)) + (8.60321926809109 / (18))) is greater than 1.9682932552436228 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (270) + (18) - 2, .975) and 0.1616365004406343 = (292.1104507801661 - 244.8947397739239) / 292.1104507801661 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 94.16523918889844 < 182.65661820519463.
IsChangePoint: Marked as a change because one of 2/20/2022 8:03:17 PM, 4/6/2022 12:51:22 AM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsImprovementStdDev: Marked as improvement because 18.905945298468392 (T) = (0 -101188.53134497307) / Math.Sqrt((1432948441.360674 / (299)) + (254327177.10292783 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.448346746378928 = (183427.77946249367 - 101188.53134497307) / 183427.77946249367 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 303.55032690269593 < 426.99357722401976.
IsChangePoint: Marked as a change because one of 2/26/2022 10:27:55 AM, 4/6/2022 12:51:22 AM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsImprovementStdDev: Marked as improvement because 38.84931692563196 (T) = (0 -317.3978968447432) / Math.Sqrt((6274.064648713179 / (299)) + (116.14987000187477 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.39066141108038244 = (520.8892110501367 - 317.3978968447432) / 520.8892110501367 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 394.34620057411934 < 462.86931182344813.
IsChangePoint: Marked as a change because one of 4/6/2022 12:51:22 AM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsImprovementStdDev: Marked as improvement because 16.759998821551363 (T) = (0 -310.2806542176445) / Math.Sqrt((4388.91152788747 / (299)) + (1162.873300911373 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.3299165590744776 = (463.0477866891971 - 310.2806542176445) / 463.0477866891971 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[DrewScoggins]

Likely: dotnet/runtime#67184