[Perf] Windows/arm64: 2 Regressions on 8/31/2023 11:52:29 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.19041
Queue	SurfaceWindows
Baseline	d9d47ee766abde6823efa2f2c382c6b4a4dd3057
Compare	f6b6415119b4d6d4421b3186a6a8aaa4803af969
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Threading.Tests.Perf_Interlocked

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
CompareExchange_object_Match - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	4.33 ns	7.01 ns	1.62	0.57	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_Interlocked*'

Payloads

Baseline
Compare

System.Threading.Tests.Perf_Interlocked.CompareExchange_object_Match

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.008284510576489 > 4.3996903877426465.
IsChangePoint: Marked as a change because one of 4/11/2023 2:19:19 PM, 8/31/2023 1:23:15 PM, 9/5/2023 8:21:55 PM falls between 8/27/2023 2:42:29 PM and 9/5/2023 8:21:55 PM.
IsRegressionStdDev: Marked as regression because -10.865782470752759 (T) = (0 -7.230693995447077) / Math.Sqrt((0.6280372951535919 / (10)) + (0.034411119035831196 / (7))) is less than -2.131449545559758 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (10) + (7) - 2, .025) and -0.6421853676472334 = (4.403092451010282 - 7.230693995447077) / 4.403092451010282 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.19041
Queue	SurfaceWindows
Baseline	d9d47ee766abde6823efa2f2c382c6b4a4dd3057
Compare	f6b6415119b4d6d4421b3186a6a8aaa4803af969
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Memory.Span<Char>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToArray - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	12.51 ns	13.76 ns	1.10	0.21	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Char>*'

Payloads

Baseline
Compare

System.Memory.Span<Char>.ToArray(Size: 33)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.756739672998332 > 13.214235152640901.
IsChangePoint: Marked as a change because one of 4/11/2023 2:19:19 PM, 5/19/2023 4:22:12 AM, 8/31/2023 1:23:15 PM, 9/5/2023 8:21:55 PM falls between 8/27/2023 2:42:29 PM and 9/5/2023 8:21:55 PM.
IsRegressionStdDev: Marked as regression because -9.008113011331744 (T) = (0 -13.986674880212348) / Math.Sqrt((0.0972119755608103 / (10)) + (0.07616220247832127 / (7))) is less than -2.131449545559758 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (10) + (7) - 2, .025) and -0.10185783996004436 = (12.693719981807757 - 13.986674880212348) / 12.693719981807757 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[EgorBo]

Same as #21386