[Perf] Windows/arm64: 1 Regression on 9/2/2023 1:56:13 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.19041
Queue	SurfaceWindows
Baseline	0241bc154b2669e12201706ba95dd23e043fae3d
Compare	c1ba5c50b8ae47dda48a239be6dd9c7b6acc5c48
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	12.22 ns	14.37 ns	1.18	0.43	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

Payloads

Baseline
Compare

System.Tests.Perf_UInt64.ToString(value: 12345)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.3701820898265 > 12.945594876344192.
IsChangePoint: Marked as a change because one of 9/1/2023 1:30:05 PM, 9/5/2023 8:21:55 PM falls between 8/27/2023 2:42:29 PM and 9/5/2023 8:21:55 PM.
IsRegressionStdDev: Marked as regression because -5.03300762035064 (T) = (0 -13.985898623338755) / Math.Sqrt((0.2505113230111986 / (12)) + (0.20673343832014357 / (5))) is less than -2.131449545559758 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (12) + (5) - 2, .025) and -0.09861847845704917 = (12.7304418208778 - 13.985898623338755) / 12.7304418208778 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[EgorBo]

Could be dotnet/runtime#91001 or noise