Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Perf] Changes at 11/23/2020 6:57:27 PM #3539

Open
performanceautofiler bot opened this issue Dec 1, 2020 · 2 comments
Open

[Perf] Changes at 11/23/2020 6:57:27 PM #3539

performanceautofiler bot opened this issue Dec 1, 2020 · 2 comments

Comments

@performanceautofiler
Copy link

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline 72185771e8dfd87d5a45732aec1566d8f3147c6e
Compare 202f6e1deede57ad127445256cd1d5c2bbad136f

Improvemnts in PerfLabTests.LowLevelPerf

Benchmark Baseline Test Test/Base Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ForeachOverList100Elements 120.35 ms 23.91 ms 0.20

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'PerfLabTests.LowLevelPerf*'

.

Payloads

Baseline
Compare

Histogram

PerfLabTests.LowLevelPerf.ForeachOverList100Elements

[ 14355644.465 ;  30271907.068) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[ 30271907.068 ;  43861186.055) | 
[ 43861186.055 ;  59777448.658) | @@@@@@@@@@@
[ 59777448.658 ;  75693711.262) | 
[ 75693711.262 ;  91609973.865) | 
[ 91609973.865 ; 112358670.042) | 
[112358670.042 ; 128309423.335) | @@

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline 72185771e8dfd87d5a45732aec1566d8f3147c6e
Compare 3f8966546a09ec104ca958eab20a22463907fed1

Improvemnts in System.Text.Json.Tests.Perf_Get

Benchmark Baseline Test Test/Base Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
GetUInt64 2.53 μs 2.15 μs 0.85
GetInt32 2.53 μs 2.08 μs 0.82
GetInt64 2.33 μs 2.18 μs 0.93

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Get*'

.

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Get.GetUInt64

[1823.431 ; 1986.251) | @@@@@@@@@@@@@@@@@@@@@@@
[1986.251 ; 2198.561) | @@@@@@@@@@@@@@@@@@
[2198.561 ; 2361.382) | 
[2361.382 ; 2485.346) | 
[2485.346 ; 2648.167) | @@@@@@

System.Text.Json.Tests.Perf_Get.GetInt32

[1855.760 ; 1974.455) | @@@@@@@
[1974.455 ; 2092.879) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[2092.879 ; 2176.206) | @@@@@@
[2176.206 ; 2294.630) | 
[2294.630 ; 2425.930) | 
[2425.930 ; 2544.354) | @@@@@

System.Text.Json.Tests.Perf_Get.GetInt64

[2081.588 ; 2137.170) | @@@
[2137.170 ; 2236.199) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[2236.199 ; 2296.423) | 
[2296.423 ; 2351.454) | @@@@@@@@@@
[2351.454 ; 2411.147) | @@

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline 72185771e8dfd87d5a45732aec1566d8f3147c6e
Compare 202f6e1deede57ad127445256cd1d5c2bbad136f

Improvemnts in System.Collections.Concurrent.AddRemoveFromDifferentThreads

Benchmark Baseline Test Test/Base Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentQueue 285.28 ms 192.69 ms 0.68

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Concurrent.AddRemoveFromDifferentThreads<String>*'

.

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.AddRemoveFromDifferentThreads.ConcurrentQueue(Size: 2000000)

[163528176.186 ; 184618666.515) | @@
[184618666.515 ; 212692242.143) | @@@@@@@@@@@@@@@@@@@@@@@@
[212692242.143 ; 234558944.919) | @@@@@@@
[234558944.919 ; 265204814.486) | @@
[265204814.486 ; 293278390.114) | @@@@@@@@@
[293278390.114 ; 321029265.014) | @

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@adamsitnik
Copy link
Collaborator

Most probably caused by dotnet/runtime#44790

@DrewScoggins the first link to historical data does not work

@DrewScoggins
Copy link
Owner

Most probably caused by dotnet/runtime#44790

@DrewScoggins the first link to historical data does not work

I will get this corrected.

DrewScoggins pushed a commit that referenced this issue Jan 22, 2024
* Update dependencies from https://github.com/dotnet/runtime build 20231202.3

Microsoft.Extensions.Logging , Microsoft.NET.ILLink , Microsoft.NET.ILLink.Tasks , System.Threading.Channels
 From Version 9.0.0-alpha.1.23602.2 -> To Version 9.0.0-alpha.1.23602.3

* Update dependencies from https://github.com/dotnet/runtime build 20231202.4

Microsoft.Extensions.Logging , Microsoft.NET.ILLink , Microsoft.NET.ILLink.Tasks , System.Threading.Channels
 From Version 9.0.0-alpha.1.23602.2 -> To Version 9.0.0-alpha.1.23602.4

* Update dependencies from https://github.com/dotnet/runtime build 20231202.6

Microsoft.Extensions.Logging , Microsoft.NET.ILLink , Microsoft.NET.ILLink.Tasks , System.Threading.Channels
 From Version 9.0.0-alpha.1.23602.2 -> To Version 9.0.0-alpha.1.23602.6

---------

Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants