[Perf] Windows/x64: 17 Regressions on 8/16/2024 4:29:39 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22631
Queue	ViperWindows
Baseline	2691fc8374c89bf79a366bdf62ded4cd856d357c
Compare	1a305e63ecf47e81464ca22b6ddc86d2d31c6202
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Enum

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToString_NonFlags_Large - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.77 ns	16.95 ns	1.57	0.24	False
ToString_Format_NonFlags - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.32 ns	15.74 ns	1.52	0.19	False
ToString_NonFlags_Large - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.80 ns	14.66 ns	1.36	0.27	False
ToString_NonFlags_Small - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	11.98 ns	14.61 ns	1.22	0.24	False
ToString_NonFlags_Large - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.75 ns	16.40 ns	1.52	0.26	False
ToString_NonFlags_Small - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	27.74 ns	38.37 ns	1.38	0.42	False
ToString_NonFlags_Large - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.75 ns	16.58 ns	1.54	0.27	False
ToString_Format_NonFlags - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.32 ns	11.52 ns	1.12	0.18	False
ToString_NonFlags_Small - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.41 ns	16.80 ns	1.61	0.24	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Enum*'

System.Tests.Perf_Enum.ToString_NonFlags_Large(value: Control)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_NonFlags(value: Saturday, format: "D")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_NonFlags_Large(value: UppercaseLetter)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_NonFlags_Small(value: AllDirectories)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_NonFlags_Large(value: Format)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_NonFlags_Small(value: -1)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_NonFlags_Large(value: OtherNotAssigned)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_NonFlags(value: Tuesday, format: "d")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_NonFlags_Small(value: TopDirectoryOnly)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22631
Queue	ViperWindows
Baseline	2691fc8374c89bf79a366bdf62ded4cd856d357c
Compare	1a305e63ecf47e81464ca22b6ddc86d2d31c6202
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Microsoft.Extensions.DependencyInjection.GetService

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Scoped - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	39.14 ns	49.39 ns	1.26	0.19	False
EmptyEnumerable - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	16.74 ns	37.15 ns	2.22	0.53	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.GetService*'

Microsoft.Extensions.DependencyInjection.GetService.Scoped

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.GetService.EmptyEnumerable

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22631
Queue	ViperWindows
Baseline	2691fc8374c89bf79a366bdf62ded4cd856d357c
Compare	1a305e63ecf47e81464ca22b6ddc86d2d31c6202
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
GetService_5Injected - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	12.11 ns	14.26 ns	1.18	0.22	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark*'

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.GetService_5Injected

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22631
Queue	ViperWindows
Baseline	2691fc8374c89bf79a366bdf62ded4cd856d357c
Compare	1a305e63ecf47e81464ca22b6ddc86d2d31c6202
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Singleton - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	17.56 ns	20.40 ns	1.16	0.56	False
Scoped - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	46.11 ns	70.19 ns	1.52	0.41	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable*'

Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable.Singleton

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable.Scoped

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22631
Queue	ViperWindows
Baseline	2691fc8374c89bf79a366bdf62ded4cd856d357c
Compare	1a305e63ecf47e81464ca22b6ddc86d2d31c6202
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
GetConverter - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	57.15 ns	84.80 ns	1.48	0.48	False
GetConverter - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	62.86 ns	118.96 ns	1.89	0.49	False
GetConverter - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	58.38 ns	70.14 ns	1.20	0.46	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.ComponentModel.Tests.Perf_TypeDescriptorTests*'

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassIDerived))

ETL Files

Histogram

JIT Disasms

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(string))

ETL Files

Histogram

JIT Disasms

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassWithNoConverter))

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[dotnet-policy-service]

Tagging subscribers to this area: @dotnet/area-system-runtime
See info in area-owners.md if you want to be subscribed.

[tannergooding]

The commit range in question really only has bug fixes. There's nothing obvious that causes these regressions and they are all on the order of 4-40ns.

@AaronRobinsonMSFT, could these be caused by #106497, that looks like the most obvious one in the commit range given what the tests are doing (often touching GetType()).

[AaronRobinsonMSFT]

Yes, it is entirely possible. There was a minor accepted performance regression in that PR. The benefit is the removal of Helper Method Frames and was thus permitted. Given the very small impact here, nanoseconds, this seems acceptable.

[tannergooding]

Closing as by design.