[Perf] Changes at 6/9/2022 10:25:37 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	3d74b00659fec817506e2888f87936518556e01c
Compare	b2add4986c2da96e6e5fbf6f1fbb947cc7e33b42
Diff	Diff

Regressions in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Fill - Duration of single invocation	5.67 ns	9.68 ns	1.71	0.09	False
IndexOfAnyTwoValues - Duration of single invocation	8.10 ns	9.62 ns	1.19	0.04	False
SequenceEqual - Duration of single invocation	10.35 ns	11.88 ns	1.15	0.06	False
Clear - Duration of single invocation	7.34 ns	9.98 ns	1.36	0.17	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Byte>.Fill(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.683111735324315 > 5.9822946980151555.
IsChangePoint: Marked as a change because one of 5/11/2022 11:37:12 AM, 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -42.372771611383975 (T) = (0 -9.677832693360399) / Math.Sqrt((0.4797560173119645 / (48)) + (7.27317829767159E-06 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.7784982907053377 = (5.441575481932148 - 9.677832693360399) / 5.441575481932148 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span<Byte>.IndexOfAnyTwoValues(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.620348032077443 > 8.525387405646688.
IsChangePoint: Marked as a change because one of 4/16/2022 5:36:25 PM, 4/20/2022 2:49:46 PM, 5/25/2022 1:42:32 AM, 5/31/2022 6:06:22 PM, 6/2/2022 5:58:32 PM, 6/6/2022 10:12:27 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -78.55983208842508 (T) = (0 -9.695002766619954) / Math.Sqrt((0.0009178539901712453 / (28)) + (0.01743069685153087 / (47))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (47) - 2, .025) and -0.19445704502300612 = (8.116660877020673 - 9.695002766619954) / 8.116660877020673 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span<Byte>.SequenceEqual(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.88251088791492 > 10.887933912769297.
IsChangePoint: Marked as a change because one of 4/25/2022 5:27:54 PM, 5/11/2022 9:09:01 PM, 5/25/2022 1:42:32 AM, 6/6/2022 10:12:27 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -32.78917110092821 (T) = (0 -11.822337787062787) / Math.Sqrt((0.000244362106398424 / (28)) + (0.09061546029585063 / (47))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (47) - 2, .025) and -0.1390251339157062 = (10.379347597379446 - 11.822337787062787) / 10.379347597379446 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span<Byte>.Clear(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.97812289801152 > 7.616186915543701.
IsChangePoint: Marked as a change because one of 5/11/2022 11:37:12 AM, 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -23.686358355864193 (T) = (0 -9.975031109015424) / Math.Sqrt((0.9407695049441225 / (48)) + (9.913436411256337E-06 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.49798552350690095 = (6.6589636231350875 - 9.975031109015424) / 6.6589636231350875 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	3d74b00659fec817506e2888f87936518556e01c
Compare	b2add4986c2da96e6e5fbf6f1fbb947cc7e33b42
Diff	Diff

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SingleSerial - Duration of single invocation	524.80 ns	569.17 ns	1.08	0.05	False
SingleSerial - Duration of single invocation	568.05 ns	633.81 ns	1.12	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: True)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 569.1713571428571 > 540.46876625.
IsChangePoint: Marked as a change because one of 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -17.937528630257642 (T) = (0 -579.3696095305929) / Math.Sqrt((115.04774479879163 / (48)) + (205.18213007906027 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.10850819466804103 = (522.6570379158032 - 579.3696095305929) / 522.6570379158032 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 633.8067142857144 > 596.23023625.
IsChangePoint: Marked as a change because one of 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -21.397392464524003 (T) = (0 -617.9828786643006) / Math.Sqrt((105.50626162722811 / (48)) + (95.72796532945056 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.09048883074800765 = (566.7026210992026 - 617.9828786643006) / 566.7026210992026 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	3d74b00659fec817506e2888f87936518556e01c
Compare	b2add4986c2da96e6e5fbf6f1fbb947cc7e33b42
Diff	Diff

Regressions in System.Threading.Tests.Perf_SemaphoreSlim

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReleaseWaitAsync_WithCancellationToken - Duration of single invocation	823.12 ns	889.47 ns	1.08	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_SemaphoreSlim*'

Payloads

Baseline
Compare

Histogram

System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWaitAsync_WithCancellationToken

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 889.4719354747973 > 859.2176370904238.
IsChangePoint: Marked as a change because one of 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -10.353473352295904 (T) = (0 -908.0226734693589) / Math.Sqrt((1602.0189560719825 / (48)) + (423.1234072430768 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.08678346694716893 = (835.5138820983739 - 908.0226734693589) / 835.5138820983739 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	3d74b00659fec817506e2888f87936518556e01c
Compare	b2add4986c2da96e6e5fbf6f1fbb947cc7e33b42
Diff	Diff

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Object>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SingleSerial - Duration of single invocation	537.69 ns	603.92 ns	1.12	0.12	False
ProducerConsumer - Duration of single invocation	905.95 ns	968.29 ns	1.07	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Object>*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: True)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 603.9242499999999 > 558.4221241282895.
IsChangePoint: Marked as a change because one of 5/2/2022 5:38:23 AM, 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -26.76184606325446 (T) = (0 -611.6048717373027) / Math.Sqrt((127.60415284024786 / (48)) + (157.56604122768198 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.14616889741315006 = (533.6079814394427 - 611.6048717373027) / 533.6079814394427 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 968.2868666666667 > 953.3145125000001.
IsChangePoint: Marked as a change because one of 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -25.224657257001468 (T) = (0 -974.5632652543485) / Math.Sqrt((63.59533168401958 / (48)) + (146.93727695627402 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.07219157002373043 = (908.9450919976724 - 974.5632652543485) / 908.9450919976724 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	3d74b00659fec817506e2888f87936518556e01c
Compare	b2add4986c2da96e6e5fbf6f1fbb947cc7e33b42
Diff	Diff

Regressions in System.Threading.Tasks.Tests.Perf_AsyncMethods

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Yield - Duration of single invocation	455.34 ns	503.94 ns	1.11	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tasks.Tests.Perf_AsyncMethods*'

Payloads

Baseline
Compare

Histogram

System.Threading.Tasks.Tests.Perf_AsyncMethods.Yield

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 503.93584 > 468.85809600000005.
IsChangePoint: Marked as a change because one of 6/9/2022 8:09:33 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM.
IsRegressionStdDev: Marked as regression because -36.2137920583448 (T) = (0 -511.18102206891865) / Math.Sqrt((63.86836518639281 / (48)) + (35.54069260895879 / (27))) is less than -1.99299712588925 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (48) + (27) - 2, .025) and -0.13027233711229758 = (452.263587530525 - 511.18102206891865) / 452.263587530525 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository