[Perf] Windows/arm64: 31 Improvements on 10/11/2022 6:23:40 AM #9090

performanceautofiler · 2022-10-20T09:44:02Z

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString - Duration of single invocation	13.83 ns	11.37 ns	0.82	0.07	False
ToString - Duration of single invocation	19.01 ns	16.87 ns	0.89	0.05	False
TryFormat - Duration of single invocation	9.46 ns	8.29 ns	0.88	0.09	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt32*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_UInt32.ToString(value: 12345)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 32.107740908825605 (T) = (0 -11.533750407822401) / Math.Sqrt((0.19993486718381986 / (299)) + (0.23347986390460782 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.2037701101493955 = (14.48545270008196 - 11.533750407822401) / 14.48545270008196 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt32.ToString(value: 4294967295)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/4/2022 3:52:14 AM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 41.71591041522907 (T) = (0 -16.16278972213845) / Math.Sqrt((0.5169030596895788 / (299)) + (0.362572733091963 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.23275027808378987 = (21.065878892431265 - 16.16278972213845) / 21.065878892431265 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt32.TryFormat(value: 4294967295)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 35.691187870470294 (T) = (0 -8.089845083118806) / Math.Sqrt((0.12271996384753832 / (299)) + (0.14412102881455824 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.24448834519580873 = (10.707770067710578 - 8.089845083118806) / 10.707770067710578 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString - Duration of single invocation	63.03 ns	34.79 ns	0.55	0.00	False
ToString - Duration of single invocation	15.75 ns	13.12 ns	0.83	0.16	False
TryFormat - Duration of single invocation	48.82 ns	24.40 ns	0.50	0.01	False
TryFormat - Duration of single invocation	8.63 ns	6.23 ns	0.72	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt64*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_UInt64.ToString(value: 18446744073709551615)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 271.6626808267549 (T) = (0 -34.289435685477244) / Math.Sqrt((0.2539614455011822 / (299)) + (0.30185873191720536 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.45282744352630155 = (62.66658530255706 - 34.289435685477244) / 62.66658530255706 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ToString(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 66.79666930768737 (T) = (0 -13.240751706313288) / Math.Sqrt((0.13889347084877615 / (299)) + (0.0589004705441828 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.1990862028354569 = (16.53205595057698 - 13.240751706313288) / 16.53205595057698 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 535.7960028857647 (T) = (0 -24.443869810192993) / Math.Sqrt((0.14525072992254043 / (299)) + (0.048657483295874854 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.5015740242585099 = (49.042126614345776 - 24.443869810192993) / 49.042126614345776 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/11/2022 10:02:44 AM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 21.300843081976975 (T) = (0 -6.340845373197027) / Math.Sqrt((0.10546703695774504 / (299)) + (0.29674606469663495 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.2537362178823705 = (8.496788300785518 - 6.340845373197027) / 8.496788300785518 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString - Duration of single invocation	13.62 ns	12.39 ns	0.91	0.12	False
TryFormat - Duration of single invocation	20.72 ns	17.90 ns	0.86	0.05	False
ToString - Duration of single invocation	18.97 ns	17.59 ns	0.93	0.24	False
TryFormat - Duration of single invocation	10.66 ns	9.16 ns	0.86	0.13	False
ToString - Duration of single invocation	32.25 ns	28.96 ns	0.90	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int32*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Int32.ToString(value: 12345)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 25.504728693299487 (T) = (0 -11.719672539459049) / Math.Sqrt((0.16881302439583382 / (299)) + (0.19658222082002547 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.15511731414098534 = (13.871360764770966 - 11.719672539459049) / 13.871360764770966 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: -2147483648)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 52.56000179153945 (T) = (0 -18.056569213712923) / Math.Sqrt((0.1773769427237612 / (299)) + (0.1471878545523926 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.17754004682771737 = (21.954344578198047 - 18.056569213712923) / 21.954344578198047 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: 2147483647)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 36.97982160765055 (T) = (0 -16.43440924651193) / Math.Sqrt((0.45058095478011795 / (299)) + (0.26820804841222384 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.18698606422147812 = (20.214179023604004 - 16.43440924651193) / 20.214179023604004 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: 2147483647)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 64.09741263882431 (T) = (0 -9.04462231009881) / Math.Sqrt((0.18464278479554477 / (299)) + (0.02755629796483157 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.2173753022974568 = (11.556781093990535 - 9.04462231009881) / 11.556781093990535 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: -2147483648)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 47.60578069940396 (T) = (0 -29.106513566901487) / Math.Sqrt((0.5568883026549527 / (299)) + (0.22622853998346062 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.13851152337101363 = (33.78630632506611 - 29.106513566901487) / 33.78630632506611 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IntegerFormatting - Duration of single invocation	2.12 ms	1.70 ms	0.80	0.43	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.LowLevelPerf*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

PerfLabTests.LowLevelPerf.IntegerFormatting

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 34.840774877890375 (T) = (0 -1757361.4468035633) / Math.Sqrt((4912412972.3347 / (299)) + (4187993765.5856566 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.1984900213962836 = (2192563.4037208166 - 1757361.4468035633) / 2192563.4037208166 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Text.Tests.Perf_StringBuilder

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Append_Primitives - Duration of single invocation	1.17 μs	1.06 μs	0.91	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Tests.Perf_StringBuilder.Append_Primitives

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 80.85719755673072 (T) = (0 -1066.510704473712) / Math.Sqrt((909.4425817979622 / (299)) + (39.34769025286846 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.1365780870461911 = (1235.2138490730752 - 1066.510704473712) / 1235.2138490730752 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_SByte

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	11.34 ns	10.24 ns	0.90	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_SByte*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_SByte.ToString(value: 127)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 9/7/2022 11:31:53 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 31.347415708216943 (T) = (0 -10.460311262402604) / Math.Sqrt((0.11263407679011836 / (299)) + (0.060436732883047455 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.12781432151475267 = (11.993216032358339 - 10.460311262402604) / 11.993216032358339 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Version

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
TryFormatL - Duration of single invocation	62.57 ns	49.22 ns	0.79	0.01	False
ToString2 - Duration of single invocation	31.85 ns	29.48 ns	0.93	0.02	False
TryFormat3 - Duration of single invocation	18.27 ns	17.02 ns	0.93	0.13	False
ToStringL - Duration of single invocation	86.90 ns	72.54 ns	0.83	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Version*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Version.TryFormatL

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 122.7791451762421 (T) = (0 -49.97593013473348) / Math.Sqrt((6.159951316917306 / (299)) + (0.2460445096605647 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.29425930829587504 = (70.81344567798482 - 49.97593013473348) / 70.81344567798482 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.ToString2

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 42.28112825544484 (T) = (0 -29.322320096452284) / Math.Sqrt((0.5669816591685818 / (299)) + (0.28648232093225956 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.1336482063127575 = (33.845742930426475 - 29.322320096452284) / 33.845742930426475 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.TryFormat3

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 22.981288300827888 (T) = (0 -16.996561623752292) / Math.Sqrt((0.16065483781687928 / (299)) + (0.20715359192557792 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.10446119620048215 = (18.97914590818476 - 16.996561623752292) / 18.97914590818476 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.ToStringL

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 115.61852241625041 (T) = (0 -72.47975426654324) / Math.Sqrt((10.45784004923226 / (299)) + (0.4025475179247129 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.25976358698381175 = (97.91433249171732 - 72.47975426654324) / 97.91433249171732 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

The text was updated successfully, but these errors were encountered:

performanceautofiler · 2022-10-20T09:44:05Z

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Byte

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	11.63 ns	10.20 ns	0.88	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Byte*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Byte.ToString(value: 255)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 35.667072091561955 (T) = (0 -10.171707459815574) / Math.Sqrt((0.1748878724096302 / (299)) + (0.0844821610242314 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.16977428222714844 = (12.251737379446654 - 10.171707459815574) / 12.251737379446654 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString - Duration of single invocation	19.00 ns	14.53 ns	0.77	0.18	False
TryFormat - Duration of single invocation	9.20 ns	6.65 ns	0.72	0.22	False
ToString - Duration of single invocation	61.11 ns	35.08 ns	0.57	0.00	False
TryFormat - Duration of single invocation	46.39 ns	25.05 ns	0.54	0.00	False
ToString - Duration of single invocation	71.09 ns	44.80 ns	0.63	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int64*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Int64.ToString(value: 12345)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 29.230316536320057 (T) = (0 -14.570490526872792) / Math.Sqrt((0.19146483960725977 / (299)) + (0.40125139875251586 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.19191863398813552 = (18.030969577708174 - 14.570490526872792) / 18.030969577708174 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryFormat(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/12/2022 1:47:38 AM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 21.015950727129205 (T) = (0 -7.219406298706254) / Math.Sqrt((0.18351792591762117 / (168)) + (0.12230058849070359 / (29))) is greater than 1.9722040512682435 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (168) + (29) - 2, .975) and 0.17499853662986992 = (8.750779991607514 - 7.219406298706254) / 8.750779991607514 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ToString(value: 9223372036854775807)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 266.7995606813523 (T) = (0 -34.56221301257543) / Math.Sqrt((0.23309822317915718 / (299)) + (0.26588147460478007 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.4350050299336006 = (61.17260302071999 - 34.56221301257543) / 61.17260302071999 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryFormat(value: 9223372036854775807)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 478.5751379743441 (T) = (0 -25.09225871497601) / Math.Sqrt((0.19505892504426756 / (258)) + (0.03958393199727586 / (30))) is greater than 1.9682932552436228 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (258) + (30) - 2, .975) and 0.4649274123956236 = (46.895055542499215 - 25.09225871497601) / 46.895055542499215 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ToString(value: -9223372036854775808)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 287.2880927821266 (T) = (0 -45.45321361037907) / Math.Sqrt((0.26466783092705337 / (299)) + (0.21924109658055682 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.36391252624718096 = (71.45748892398721 - 45.45321361037907) / 71.45748892398721 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Decimal

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	81.14 ns	76.57 ns	0.94	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Decimal*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Decimal.ToString(value: 123456.789)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 58.60928456390786 (T) = (0 -76.5330799680151) / Math.Sqrt((1.114316227446469 / (299)) + (0.24553628627968965 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.07713245421537428 = (82.92964718240944 - 76.5330799680151) / 82.92964718240944 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Int16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	13.86 ns	11.55 ns	0.83	0.10	False
ToString - Duration of single invocation	26.42 ns	23.89 ns	0.90	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int16*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Int16.ToString(value: 32767)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 27.665521904909607 (T) = (0 -11.615444846471393) / Math.Sqrt((0.12410912313134732 / (299)) + (0.1749926488848428 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.15843989400945838 = (13.802275991682928 - 11.615444846471393) / 13.802275991682928 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int16.ToString(value: -32768)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 28.46082311083695 (T) = (0 -24.42267569038404) / Math.Sqrt((0.38457261526339975 / (299)) + (0.2614883395548782 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.10438310412109594 = (27.26911004332618 - 24.42267569038404) / 27.26911004332618 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_UInt16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	13.50 ns	11.34 ns	0.84	0.06	False
ToString - Duration of single invocation	13.49 ns	11.34 ns	0.84	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt16*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_UInt16.ToString(value: 65535)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 39.21717518050332 (T) = (0 -11.38683039769695) / Math.Sqrt((0.2132071347138702 / (299)) + (0.16521596542665948 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.21360781207952995 = (14.479836616648246 - 11.38683039769695) / 14.479836616648246 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt16.ToString(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/3/2022 10:42:38 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 42.309710807885594 (T) = (0 -11.373748447583488) / Math.Sqrt((0.29374923411325315 / (299)) + (0.1306303377132233 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.21368451791100654 = (14.464612113915152 - 11.373748447583488) / 14.464612113915152 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	43f7699377fff108c74e19bea9f7ecf66286952f
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterInt64 - Duration of single invocation	48.08 ns	45.56 ns	0.95	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 9223372036854775807)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 10/10/2022 11:56:05 PM, 10/19/2022 4:51:05 PM falls between 10/10/2022 11:56:05 PM and 10/19/2022 4:51:05 PM.
IsImprovementStdDev: Marked as improvement because 18.54997071983829 (T) = (0 -45.34952525805203) / Math.Sqrt((0.21897332525604885 / (299)) + (0.8132724556253417 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06389141583527735 = (48.44472748694727 - 45.34952525805203) / 48.44472748694727 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

AndyAyersMS · 2022-11-03T16:35:49Z

dotnet/runtime#76726

performanceautofiler bot added the arm64 label Oct 20, 2022

performanceautofiler bot added CoreClr untriaged labels Oct 20, 2022

performanceautofiler bot mentioned this issue Oct 20, 2022

[Perf] Windows/arm64: 9 Improvements on 10/11/2022 6:23:40 AM #9101

Closed

AndyAyersMS closed this as completed Nov 3, 2022

AndyAyersMS removed the untriaged label Nov 3, 2022

performanceautofiler bot added os-windows perf-improvement branch-refs/heads/main arch-arm64 runtime-coreclr kind-micro and removed refs/heads/main labels Mar 24, 2023

[Perf] Windows/arm64: 31 Improvements on 10/11/2022 6:23:40 AM #9090

[Perf] Windows/arm64: 31 Improvements on 10/11/2022 6:23:40 AM #9090

Comments

performanceautofiler bot commented Oct 20, 2022 • edited Loading

Run Information

Improvements in System.Tests.Perf_UInt32

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Tests.Perf_UInt32.ToString(value: 12345)

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Improvements in System.Tests.Perf_UInt64

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Tests.Perf_UInt64.ToString(value: 18446744073709551615)

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Run Information

Improvements in System.Tests.Perf_Int32

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Tests.Perf_Int32.ToString(value: 12345)

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Run Information

Improvements in PerfLabTests.LowLevelPerf

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

PerfLabTests.LowLevelPerf.IntegerFormatting

Description of detection logic

Docs

Run Information

Improvements in System.Text.Tests.Perf_StringBuilder

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Text.Tests.Perf_StringBuilder.Append_Primitives

Description of detection logic

Docs

Run Information

Improvements in System.Tests.Perf_SByte

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

performanceautofiler bot commented Oct 20, 2022 •

edited

Loading

performanceautofiler bot commented Oct 20, 2022 •

edited

Loading