Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Arm64]: Regression in Microsoft.Extensions.DependencyInjection.TimeToFirstService #58189

Closed
performanceautofiler bot opened this issue Aug 24, 2021 · 3 comments
Labels
arch-arm64 area-Extensions-DependencyInjection os-linux Linux OS (any supported distro) untriaged New issue has not been triaged by the area owner

Comments

@performanceautofiler
Copy link

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline 4803ce2c8f7bd335a2e81aa3c312c61707f70b0e
Compare 3c903d622ca8d9269b8c5384e32e357882001450
Diff Diff

Regressions in Microsoft.Extensions.DependencyInjection.TimeToFirstService

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Singleton - Duration of single invocation 19.51 μs 21.41 μs 1.10 0.02 False
Transient - Duration of single invocation 19.25 μs 21.08 μs 1.10 0.08 False
Scoped - Duration of single invocation 21.14 μs 22.77 μs 1.08 0.07 False
BuildProvider - Duration of single invocation 9.33 μs 10.21 μs 1.10 0.30 False
Scoped - Duration of single invocation 20.98 μs 23.96 μs 1.14 0.05 False
BuildProvider - Duration of single invocation 9.45 μs 10.92 μs 1.16 0.29 False
Scoped - Duration of single invocation 20.81 μs 23.30 μs 1.12 0.05 False
Scoped - Duration of single invocation 20.83 μs 22.88 μs 1.10 0.08 False
Singleton - Duration of single invocation 19.68 μs 21.40 μs 1.09 0.02 False
BuildProvider - Duration of single invocation 8.83 μs 10.89 μs 1.23 0.36 False
BuildProvider - Duration of single invocation 9.34 μs 10.67 μs 1.14 0.24 True
Transient - Duration of single invocation 19.34 μs 20.96 μs 1.08 0.02 False
Singleton - Duration of single invocation 19.61 μs 21.43 μs 1.09 0.03 False
Transient - Duration of single invocation 19.16 μs 21.05 μs 1.10 0.05 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.DependencyInjection.TimeToFirstService*'

Payloads

Baseline
Compare

Histogram

Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "Dynamic")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Transient(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "Dynamic")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "Runtime")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "Dynamic")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "Runtime")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Transient(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Transient(Mode: "Runtime")


Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@EgorBo
Copy link
Member

EgorBo commented Aug 26, 2021

#56809

@kunalspathak kunalspathak changed the title [Perf] Changes at 8/7/2021 3:21:54 PM [Arm64]: Regression in Microsoft.Extensions.DependencyInjection.TimeToFirstService Aug 26, 2021
@kunalspathak kunalspathak transferred this issue from dotnet/perf-autofiling-issues Aug 26, 2021
@dotnet-issue-labeler dotnet-issue-labeler bot added area-Extensions-DependencyInjection untriaged New issue has not been triaged by the area owner labels Aug 26, 2021
@ghost
Copy link

ghost commented Aug 26, 2021

Tagging subscribers to this area: @eerhardt, @maryamariyan
See info in area-owners.md if you want to be subscribed.

Issue Details

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline 4803ce2c8f7bd335a2e81aa3c312c61707f70b0e
Compare 3c903d622ca8d9269b8c5384e32e357882001450
Diff Diff

Regressions in Microsoft.Extensions.DependencyInjection.TimeToFirstService

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Singleton - Duration of single invocation 19.51 μs 21.41 μs 1.10 0.02 False
Transient - Duration of single invocation 19.25 μs 21.08 μs 1.10 0.08 False
Scoped - Duration of single invocation 21.14 μs 22.77 μs 1.08 0.07 False
BuildProvider - Duration of single invocation 9.33 μs 10.21 μs 1.10 0.30 False
Scoped - Duration of single invocation 20.98 μs 23.96 μs 1.14 0.05 False
BuildProvider - Duration of single invocation 9.45 μs 10.92 μs 1.16 0.29 False
Scoped - Duration of single invocation 20.81 μs 23.30 μs 1.12 0.05 False
Scoped - Duration of single invocation 20.83 μs 22.88 μs 1.10 0.08 False
Singleton - Duration of single invocation 19.68 μs 21.40 μs 1.09 0.02 False
BuildProvider - Duration of single invocation 8.83 μs 10.89 μs 1.23 0.36 False
BuildProvider - Duration of single invocation 9.34 μs 10.67 μs 1.14 0.24 True
Transient - Duration of single invocation 19.34 μs 20.96 μs 1.08 0.02 False
Singleton - Duration of single invocation 19.61 μs 21.43 μs 1.09 0.03 False
Transient - Duration of single invocation 19.16 μs 21.05 μs 1.10 0.05 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.DependencyInjection.TimeToFirstService*'

Payloads

Baseline
Compare

Histogram

Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "Dynamic")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Transient(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "Dynamic")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "Runtime")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "Dynamic")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Scoped(Mode: "Runtime")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "ILEmit")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Transient(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "Expressions")


Microsoft.Extensions.DependencyInjection.TimeToFirstService.Transient(Mode: "Runtime")


Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Author: performanceautofiler[bot]
Assignees: -
Labels:

untriaged, area-Extensions-DependencyInjection

Milestone: -

@kunalspathak kunalspathak added arch-arm64 os-linux Linux OS (any supported distro) labels Aug 26, 2021
@eerhardt
Copy link
Member

Duplicate of #57146

@eerhardt eerhardt marked this as a duplicate of #57146 Aug 26, 2021
@ghost ghost locked as resolved and limited conversation to collaborators Sep 25, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
arch-arm64 area-Extensions-DependencyInjection os-linux Linux OS (any supported distro) untriaged New issue has not been triaged by the area owner
Projects
None yet
Development

No branches or pull requests

3 participants