Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

Add baseline benchmarks #4777

Merged
merged 10 commits into from
Jan 30, 2022
Merged

Add baseline benchmarks #4777

merged 10 commits into from
Jan 30, 2022

Conversation

ggwpez
Copy link
Member

@ggwpez ggwpez commented Jan 24, 2022 •
edited
Loading

CI does currently not work because of a problem in Substrate, but should, once fixed.

  • Update the weights for pallet Balances to see that the production profile causes lower weights
  • Add the baseline benchmarks to Polkadot and Kusama

related paritytech/bench-bot#79 and paritytech/substrate#10692

@ggwpez
Don't merge this
d0fcc4f 
Signed-off-by: Oliver Tale-Yazdi <[email protected]>
@ggwpez ggwpez self-assigned this Jan 24, 2022
@github-actions github-actions bot added the A3-in_progress Pull request is in progress. No review needed at this stage. label Jan 24, 2022
@ggwpez
Copy link
Member Author

ggwpez commented Jan 24, 2022

/benchmark runtime polkadot pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jan 24, 2022 •
edited
Loading

Benchmark Runtime Polkadot Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results 
Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.35
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.35
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.39
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.39
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    15.19
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    15.19
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.27
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.27
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:2 w:2)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.72
              µs

Reads = 2
Writes = 2

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.72
              µs

Reads = 2
Writes = 2

Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    28.22
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    28.22
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_unreserve", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     13.5
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     13.5
              µs

Reads = 1
Writes = 1

cargo run --quiet --profile=production --features=runtime-benchmarks …
d1ced9b 
…-- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/
@ggwpez
Copy link
Member Author

ggwpez commented Jan 24, 2022

/benchy runtime kusama pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jan 24, 2022 •
edited
Loading

Benchmark Runtime Kusama Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results 
Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    29.99
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    29.99
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.26
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.26
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    14.78
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    14.78
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.21
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.21
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:2 w:2)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.53
              µs

Reads = 2
Writes = 2

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.53
              µs

Reads = 2
Writes = 2

Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    27.93
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    27.93
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_unreserve", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    13.64
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    13.64
              µs

Reads = 1
Writes = 1

cargo run --quiet --profile=production --features=runtime-benchmarks …
b90ac77 
…-- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/
@ggwpez
Add baseline benches
0b9c96d 
Signed-off-by: Oliver Tale-Yazdi <[email protected]>
@ggwpez
Revert "Don't merge this"
5f3565b 
This reverts commit d0fcc4f.
@ggwpez
Copy link
Member Author

ggwpez commented Jan 26, 2022

/benchthis runtime polkadot frame_benchmarking::baseline

@ggwpez
Copy link
Member Author

ggwpez commented Jan 26, 2022

/bench runtime kusama frame_benchmarking::baseline

@joao-paulo-parity joao-paulo-parity mentioned this pull request Jan 27, 2022
Closed
@ggwpez
Copy link
Member Author

ggwpez commented Jan 27, 2022

/bench runtime kusama frame_benchmarking::baseline

1 similar comment
@joao-paulo-parity
Copy link
Contributor

/bench runtime kusama frame_benchmarking::baseline

@parity-benchapp
Copy link

parity-benchapp bot commented Jan 28, 2022 •
edited
Loading

Benchmark Runtime Kusama Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/frame_benchmarking_baseline.rs

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results 
Pallet: "frame_benchmarking::baseline", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.127     0.004    3.1%
20000     0.131     0.003    2.2%
40000     0.136     0.004    2.9%
60000     0.135     0.004    2.9%
80000     0.127     0.003    2.3%
100000     0.131     0.007    5.3%
120000     0.107         0    0.0%
140000     0.128     0.002    1.5%
160000     0.127     0.002    1.5%
180000     0.112     0.004    3.5%
200000     0.127     0.003    2.3%
220000     0.128     0.002    1.5%
240000     0.122     0.007    5.7%
260000     0.123     0.005    4.0%
280000     0.133     0.007    5.2%
300000     0.134     0.004    2.9%
320000     0.135     0.006    4.4%
340000     0.133     0.004    3.0%
360000     0.134     0.005    3.7%
380000     0.132     0.004    3.0%
400000     0.132     0.003    2.2%
420000     0.122     0.003    2.4%
440000      0.13     0.004    3.0%
460000     0.123     0.002    1.6%
480000     0.133     0.003    2.2%
500000     0.134     0.004    2.9%
520000     0.123     0.007    5.6%
540000     0.135     0.002    1.4%
560000     0.132     0.003    2.2%
580000     0.124     0.002    1.6%
600000      0.14     0.003    2.1%
620000     0.135     0.004    2.9%
640000     0.138     0.003    2.1%
660000     0.129     0.003    2.3%
680000     0.117     0.004    3.4%
700000     0.123     0.002    1.6%
720000     0.115      0.01    8.6%
740000      0.13     0.004    3.0%
760000     0.132     0.003    2.2%
780000     0.127     0.002    1.5%
800000     0.133     0.004    3.0%
820000     0.134     0.004    2.9%
840000     0.124     0.005    4.0%
860000     0.132     0.004    3.0%
880000     0.125     0.007    5.6%
900000     0.122     0.005    4.0%
920000     0.132     0.003    2.2%
940000     0.128     0.003    2.3%
960000     0.125     0.001    0.8%
980000     0.128     0.005    3.9%
1000000     0.141     0.006    4.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.137     0.005    3.6%
20000     0.128     0.003    2.3%
40000     0.139     0.005    3.5%
60000     0.128     0.004    3.1%
80000     0.124     0.004    3.2%
100000     0.137     0.001    0.7%
120000     0.139     0.003    2.1%
140000     0.137     0.003    2.1%
160000     0.114     0.005    4.3%
180000     0.128     0.001    0.7%
200000     0.132     0.003    2.2%
220000     0.128     0.006    4.6%
240000     0.131     0.001    0.7%
260000     0.129     0.002    1.5%
280000     0.125     0.003    2.4%
300000     0.127     0.008    6.2%
320000     0.129     0.004    3.1%
340000     0.137     0.003    2.1%
360000      0.13     0.004    3.0%
380000     0.101     0.001    0.9%
400000     0.124     0.002    1.6%
420000     0.127     0.004    3.1%
440000     0.125     0.009    7.2%
460000     0.122     0.007    5.7%
480000     0.131     0.003    2.2%
500000     0.131     0.004    3.0%
520000     0.122     0.002    1.6%
540000     0.136     0.007    5.1%
560000     0.143     0.005    3.4%
580000     0.125     0.004    3.2%
600000      0.13     0.003    2.3%
620000     0.132     0.004    3.0%
640000     0.119     0.003    2.5%
660000     0.127     0.002    1.5%
680000     0.127     0.002    1.5%
700000     0.136     0.005    3.6%
720000     0.139     0.002    1.4%
740000      0.13     0.003    2.3%
760000      0.13     0.003    2.3%
780000     0.126     0.003    2.3%
800000     0.142     0.005    3.5%
820000     0.138     0.004    2.8%
840000     0.134     0.005    3.7%
860000     0.137     0.003    2.1%
880000     0.131     0.002    1.5%
900000      0.14     0.004    2.8%
920000     0.131     0.003    2.2%
940000      0.14     0.002    1.4%
960000     0.135     0.007    5.1%
980000     0.132     0.003    2.2%
1000000     0.133     0.003    2.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.134
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.133     0.002    1.5%
20000     0.138     0.004    2.8%
40000     0.134     0.001    0.7%
60000     0.137     0.003    2.1%
80000     0.132     0.004    3.0%
100000     0.137     0.002    1.4%
120000     0.137     0.002    1.4%
140000     0.132     0.003    2.2%
160000     0.132     0.001    0.7%
180000     0.129     0.001    0.7%
200000     0.133     0.001    0.7%
220000     0.134     0.005    3.7%
240000     0.141     0.004    2.8%
260000     0.135     0.005    3.7%
280000     0.136     0.006    4.4%
300000     0.136     0.002    1.4%
320000     0.135     0.004    2.9%
340000     0.139     0.001    0.7%
360000      0.14     0.004    2.8%
380000     0.122      0.01    8.1%
400000     0.127     0.004    3.1%
420000     0.134     0.005    3.7%
440000     0.138     0.003    2.1%
460000     0.126      0.01    7.9%
480000     0.129     0.003    2.3%
500000     0.119     0.012   10.0%
520000     0.133     0.004    3.0%
540000     0.139     0.004    2.8%
560000     0.137     0.004    2.9%
580000     0.135     0.005    3.7%
600000     0.133     0.002    1.5%
620000     0.112     0.003    2.6%
640000     0.134     0.002    1.4%
660000      0.14     0.003    2.1%
680000     0.135     0.002    1.4%
700000     0.114     0.003    2.6%
720000     0.129     0.001    0.7%
740000     0.131     0.004    3.0%
760000      0.13     0.006    4.6%
780000     0.141     0.004    2.8%
800000     0.144     0.004    2.7%
820000     0.134     0.003    2.2%
840000     0.127     0.011    8.6%
860000     0.138     0.002    1.4%
880000     0.136     0.001    0.7%
900000     0.141     0.004    2.8%
920000     0.137     0.005    3.6%
940000     0.138     0.003    2.1%
960000      0.14     0.006    4.2%
980000     0.149     0.004    2.6%
1000000     0.137     0.002    1.4%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.133
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.147
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.145     0.001    0.6%
20000     0.142      0.01    7.0%
40000     0.155     0.002    1.2%
60000     0.146     0.002    1.3%
80000     0.143     0.007    4.8%
100000     0.134     0.005    3.7%
120000     0.135     0.004    2.9%
140000     0.145     0.003    2.0%
160000     0.139     0.004    2.8%
180000     0.158     0.002    1.2%
200000     0.142     0.004    2.8%
220000     0.142     0.001    0.7%
240000     0.143     0.001    0.6%
260000     0.142     0.009    6.3%
280000     0.146     0.003    2.0%
300000     0.148     0.003    2.0%
320000     0.142     0.013    9.1%
340000     0.153     0.004    2.6%
360000     0.141     0.003    2.1%
380000     0.138     0.005    3.6%
400000     0.146     0.003    2.0%
420000      0.14     0.004    2.8%
440000     0.128     0.003    2.3%
460000     0.133     0.008    6.0%
480000     0.138     0.013    9.4%
500000     0.146     0.003    2.0%
520000     0.143     0.005    3.4%
540000     0.143     0.004    2.7%
560000     0.142     0.002    1.4%
580000     0.139     0.005    3.5%
600000     0.145     0.002    1.3%
620000     0.132     0.003    2.2%
640000     0.147     0.001    0.6%
660000     0.142     0.007    4.9%
680000     0.132     0.005    3.7%
700000     0.127     0.009    7.0%
720000     0.142     0.002    1.4%
740000     0.145     0.002    1.3%
760000     0.135     0.007    5.1%
780000     0.136     0.004    2.9%
800000     0.137     0.003    2.1%
820000     0.136      0.01    7.3%
840000     0.113     0.003    2.6%
860000      0.11     0.002    1.8%
880000      0.15     0.003    2.0%
900000     0.122     0.007    5.7%
920000     0.111     0.003    2.7%
940000     0.142     0.002    1.4%
960000      0.14     0.003    2.1%
980000     0.136     0.005    3.6%
1000000      0.14     0.003    2.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.147
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    19700
    + i    0.224
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     19690      26.1    0.1%
    2     19710     23.31    0.1%
    4     19720     25.39    0.1%
    6     19680     53.84    0.2%
    8     19690     21.56    0.1%
   10     19700      21.4    0.1%
   12     19720     43.01    0.2%
   14     19700     44.16    0.2%
   16     19720     43.69    0.2%
   18     19710     49.47    0.2%
   20     19700     28.24    0.1%
   22     19740     33.07    0.1%
   24     19720     21.79    0.1%
   26     19680     39.65    0.2%
   28     19690        43    0.2%
   30     19700      45.5    0.2%
   32     19720     29.04    0.1%
   34     19720     43.67    0.2%
   36     19710     68.82    0.3%
   38     19700     39.62    0.2%
   40     19720     31.33    0.1%
   42     19710     27.27    0.1%
   44     19740      43.7    0.2%
   46     19720     42.17    0.2%
   48     19720     21.83    0.1%
   50     19700     15.86    0.0%
   52     19700     28.52    0.1%
   54     19700      22.1    0.1%
   56     19730     30.48    0.1%
   58     19990       304    1.5%
   60     19690     20.21    0.1%
   62     19790     94.89    0.4%
   64     19920     108.6    0.5%
   66     19720     21.68    0.1%
   68     19700     21.49    0.1%
   70     19720     32.33    0.1%
   72     19690     20.78    0.1%
   74     19690     20.16    0.1%
   76     19720     44.77    0.2%
   78     19730     29.51    0.1%
   80     19740     43.06    0.2%
   82     19720     40.29    0.2%
   84     19720     15.49    0.0%
   86     19720     29.76    0.1%
   88     19720     44.91    0.2%
   90     19700     40.45    0.2%
   92     19720     55.64    0.2%
   94     19790     35.05    0.1%
   96     19710     24.45    0.1%
   98     19700     33.97    0.1%
  100     19700      40.9    0.2%

Quality and confidence:
param     error
i         0.116

Model:
Time ~=    19710
    + i     0.32
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "sr25519_verification", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    1.018
    + i    47.43
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    1     48.42     0.188    0.3%
    2     95.77     0.297    0.3%
    3     143.2     0.195    0.1%
    4     190.7     0.569    0.2%
    5     237.5     0.258    0.1%
    6     284.9     0.518    0.1%
    7     331.7     0.488    0.1%
    8     379.2     0.682    0.1%
    9     426.6     0.593    0.1%
   10     473.9      0.38    0.0%
   11     521.5     0.695    0.1%
   12     567.9     0.532    0.0%
   13     615.3     0.475    0.0%
   14     663.7     1.681    0.2%
   15     710.6     1.528    0.2%
   16     757.2     0.757    0.0%
   17       809     7.344    0.9%
   18     861.1      8.35    0.9%
   19       899     0.708    0.0%
   20       947     1.928    0.2%
   21      1011     12.58    1.2%
   22      1042     1.254    0.1%
   23      1093     10.09    0.9%
   24      1138     7.808    0.6%
   25      1195      11.8    0.9%
   26      1237     11.15    0.9%
   27      1282     11.71    0.9%
   28      1333     11.71    0.8%
   29      1372     1.248    0.0%
   30      1428        10    0.7%
   31      1477      12.1    0.8%
   32      1527     13.01    0.8%
   33      1563     7.893    0.5%
   34      1612     9.905    0.6%
   35      1664     13.16    0.7%
   36      1702     1.749    0.1%
   37      1757     12.24    0.6%
   38      1796     0.847    0.0%
   39      1861     14.02    0.7%
   40      1897     9.968    0.5%
   41      1945        12    0.6%
   42      2003     15.04    0.7%
   43      2040     12.95    0.6%
   44      2094     12.71    0.6%
   45      2139     12.78    0.5%
   46      2182     11.57    0.5%
   47      2238     15.16    0.6%
   48      2299     6.184    0.2%
   49      2326     13.03    0.5%
   50      2373     13.19    0.5%
   51      2414     8.247    0.3%
   52      2478     13.85    0.5%
   53      2515     14.37    0.5%
   54      2560     12.95    0.5%
   55      2609     12.24    0.4%
   56      2649     8.177    0.3%
   57      2715     12.07    0.4%
   58      2763     10.48    0.3%
   59      2809     13.41    0.4%
   60      2859     20.36    0.7%
   61      2901     16.45    0.5%
   62      2940     13.59    0.4%
   63      3007     9.492    0.3%
   64      3058     9.776    0.3%
   65      3086     14.92    0.4%
   66      3134     12.84    0.4%
   67      3182     13.16    0.4%
   68      3236     12.02    0.3%
   69      3285     13.63    0.4%
   70      3335     14.94    0.4%
   71      3384      16.9    0.4%
   72      3415     12.87    0.3%
   73      3470     11.62    0.3%
   74      3519     9.233    0.2%
   75      3565     22.02    0.6%
   76      3610     15.91    0.4%
   77      3652     13.14    0.3%
   78      3711     3.613    0.0%
   79      3776     14.19    0.3%
   80      3821        14    0.3%
   81      3867     18.34    0.4%
   82      3905      13.3    0.3%
   83      3944     11.96    0.3%
   84      3993     12.63    0.3%
   85      4040     14.45    0.3%
   86      4099      18.9    0.4%
   87      4147      12.3    0.2%
   88      4200     13.34    0.3%
   89      4237     14.61    0.3%
   90      4281     19.21    0.4%
   91      4328     10.74    0.2%
   92      4376      5.19    0.1%
   93      4416     17.33    0.3%
   94      4474      19.7    0.4%
   95      4517      4.85    0.1%
   96      4574     16.06    0.3%
   97      4602      16.9    0.3%
   98      4686     16.61    0.3%
   99      4719     14.17    0.3%
  100      4759     11.79    0.2%

Quality and confidence:
param     error
i         0.014

Model:
Time ~=        0
    + i    47.62
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    2.014
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.126     0.009    7.1%
   20     33.25     0.131    0.3%
   40      64.7     0.197    0.3%
   60      96.3     0.445    0.4%
   80     129.2     0.776    0.6%
  100     163.3     1.448    0.8%
  120     201.4     1.504    0.7%
  140     237.3     1.132    0.4%
  160     272.1     1.074    0.3%
  180     309.7     1.028    0.3%
  200     340.6     2.494    0.7%
  220     384.6     0.986    0.2%
  240     438.6     8.319    1.8%
  260     468.3     2.068    0.4%
  280     515.7     5.622    1.0%
  300     551.6     2.768    0.5%
  320       597     6.571    1.1%
  340     628.1     8.009    1.2%
  360     675.1     12.24    1.8%
  380     705.3      3.73    0.5%
  400     739.3     3.526    0.4%
  420     778.3     10.01    1.2%
  440     819.7     3.227    0.3%
  460     887.3      11.7    1.3%
  480     889.2     3.826    0.4%
  500     961.2     12.35    1.2%
  520     993.2     6.245    0.6%
  540      1037      11.8    1.1%
  560      1072     5.772    0.5%
  580      1100     9.338    0.8%
  600      1146     3.567    0.3%
  620      1200     13.78    1.1%
  640      1246     10.26    0.8%
  660      1292     9.428    0.7%
  680      1339      10.7    0.7%
  700      1361     10.15    0.7%
  720      1400     13.14    0.9%
  740      1454     12.59    0.8%
  760      1477     5.191    0.3%
  780      1521     9.816    0.6%
  800      1543     6.791    0.4%
  820      1604      8.12    0.5%
  840      1648     8.174    0.4%
  860      1701      6.53    0.3%
  880      1729     15.59    0.9%
  900      1803      11.4    0.6%
  920      1820     11.09    0.6%
  940      1892     7.701    0.4%
  960      1949     15.82    0.8%
  980      1975     16.58    0.8%
 1000      2003     8.639    0.4%

Quality and confidence:
param     error
i         0.003

Model:
Time ~=        0
    + i    2.027
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.323
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.118     0.005    4.2%
   20      4.74     0.062    1.3%
   40     9.831     0.051    0.5%
   60     14.75     0.049    0.3%
   80     19.57     0.077    0.3%
  100     24.66     0.059    0.2%
  120     31.88      0.14    0.4%
  140     37.31     0.104    0.2%
  160     42.23     0.478    1.1%
  180     47.68     0.088    0.1%
  200     52.99     0.156    0.2%
  220     59.21     0.191    0.3%
  240     64.29     0.209    0.3%
  260     69.99      0.22    0.3%
  280     76.96     0.677    0.8%
  300     82.05     0.356    0.4%
  320     87.64     0.202    0.2%
  340     93.43     0.285    0.3%
  360       101     0.436    0.4%
  380     105.4     0.498    0.4%
  400     113.9     1.068    0.9%
  420     119.1     0.711    0.5%
  440     124.7     0.739    0.5%
  460     131.4     1.563    1.1%
  480     140.8     2.137    1.5%
  500     144.3     1.124    0.7%
  520     150.8     0.946    0.6%
  540     160.5     1.409    0.8%
  560     164.5      0.86    0.5%
  580     173.3      2.96    1.7%
  600     178.8     1.758    0.9%
  620     186.3     3.223    1.7%
  640     204.6     0.906    0.4%
  660     202.8     2.744    1.3%
  680     209.6     2.891    1.3%
  700     219.3      2.41    1.0%
  720       224     3.642    1.6%
  740       229     3.174    1.3%
  760     236.6     4.391    1.8%
  780     243.9     5.021    2.0%
  800     257.6     0.718    0.2%
  820     256.3      6.57    2.5%
  840     264.2     6.029    2.2%
  860     273.4      3.23    1.1%
  880     282.2     4.062    1.4%
  900     289.3     3.762    1.3%
  920     294.1     3.735    1.2%
  940     300.2     3.463    1.1%
  960     308.9     3.076    0.9%
  980     318.1     7.928    2.4%
 1000     325.8     0.647    0.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.329
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

@paritytech paritytech deleted a comment from parity-benchapp bot Jan 28, 2022
cargo run --quiet --profile=production --features=runtime-benchmarks …
0865b52 
…-- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/frame_benchmarking_baseline.rs
@ggwpez
Copy link
Member Author

ggwpez commented Jan 29, 2022

/benchthis runtime polkadot frame_benchmarking::baseline

@parity-benchapp
Copy link

parity-benchapp bot commented Jan 29, 2022 •
edited
Loading

Benchmark Runtime Polkadot Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/frame_benchmarking_baseline.rs

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results 
Pallet: "frame_benchmarking::baseline", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.106     0.004    3.7%
20000     0.108     0.002    1.8%
40000     0.105     0.004    3.8%
60000     0.117     0.003    2.5%
80000     0.113     0.002    1.7%
100000     0.113     0.002    1.7%
120000     0.108     0.004    3.7%
140000     0.107     0.002    1.8%
160000     0.117     0.002    1.7%
180000     0.106     0.003    2.8%
200000     0.118     0.004    3.3%
220000      0.11     0.002    1.8%
240000     0.115     0.002    1.7%
260000     0.116     0.003    2.5%
280000      0.12     0.002    1.6%
300000     0.107     0.003    2.8%
320000     0.116     0.003    2.5%
340000     0.111     0.001    0.9%
360000     0.111     0.005    4.5%
380000     0.112     0.005    4.4%
400000     0.118     0.004    3.3%
420000     0.115     0.001    0.8%
440000     0.107     0.004    3.7%
460000      0.11     0.005    4.5%
480000      0.12     0.003    2.5%
500000     0.115     0.002    1.7%
520000     0.116     0.001    0.8%
540000     0.113     0.005    4.4%
560000     0.105     0.003    2.8%
580000     0.112     0.004    3.5%
600000     0.118     0.004    3.3%
620000     0.113     0.003    2.6%
640000     0.111     0.007    6.3%
660000     0.109     0.004    3.6%
680000     0.112     0.001    0.8%
700000     0.113     0.006    5.3%
720000     0.113     0.003    2.6%
740000     0.113     0.005    4.4%
760000     0.117     0.005    4.2%
780000     0.115     0.003    2.6%
800000     0.116     0.002    1.7%
820000     0.113     0.003    2.6%
840000     0.111     0.004    3.6%
860000     0.114     0.002    1.7%
880000     0.111     0.003    2.7%
900000     0.113     0.002    1.7%
920000     0.109     0.004    3.6%
940000     0.109     0.004    3.6%
960000     0.112     0.003    2.6%
980000     0.114     0.001    0.8%
1000000      0.11     0.002    1.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.109     0.004    3.6%
20000     0.108     0.003    2.7%
40000     0.118     0.001    0.8%
60000     0.119     0.002    1.6%
80000     0.112     0.003    2.6%
100000     0.115     0.004    3.4%
120000     0.111     0.004    3.6%
140000     0.109     0.006    5.5%
160000     0.109     0.003    2.7%
180000     0.106     0.001    0.9%
200000     0.115     0.004    3.4%
220000     0.109     0.004    3.6%
240000     0.104     0.002    1.9%
260000     0.109     0.004    3.6%
280000     0.112     0.002    1.7%
300000     0.112     0.004    3.5%
320000     0.115     0.001    0.8%
340000     0.107     0.002    1.8%
360000      0.11     0.003    2.7%
380000      0.11     0.002    1.8%
400000     0.114     0.003    2.6%
420000     0.117     0.003    2.5%
440000     0.113     0.003    2.6%
460000     0.116     0.004    3.4%
480000     0.117     0.003    2.5%
500000      0.11     0.004    3.6%
520000     0.111     0.003    2.7%
540000     0.112     0.002    1.7%
560000     0.112     0.003    2.6%
580000     0.112     0.003    2.6%
600000     0.118     0.004    3.3%
620000     0.108     0.001    0.9%
640000     0.112     0.006    5.3%
660000      0.11     0.003    2.7%
680000     0.106     0.003    2.8%
700000     0.111     0.003    2.7%
720000     0.114     0.003    2.6%
740000     0.117     0.003    2.5%
760000     0.112     0.005    4.4%
780000     0.111     0.005    4.5%
800000      0.11     0.003    2.7%
820000      0.11     0.003    2.7%
840000      0.12     0.005    4.1%
860000     0.114     0.002    1.7%
880000     0.112     0.003    2.6%
900000     0.109     0.003    2.7%
920000     0.107     0.002    1.8%
940000     0.117     0.003    2.5%
960000      0.11     0.003    2.7%
980000     0.116     0.001    0.8%
1000000     0.111     0.005    4.5%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.116     0.006    5.1%
20000     0.107     0.003    2.8%
40000     0.111     0.003    2.7%
60000     0.105     0.002    1.9%
80000     0.116     0.001    0.8%
100000     0.116     0.003    2.5%
120000     0.112     0.003    2.6%
140000     0.108     0.002    1.8%
160000     0.112     0.005    4.4%
180000     0.107     0.003    2.8%
200000     0.111     0.003    2.7%
220000     0.116     0.002    1.7%
240000     0.116     0.002    1.7%
260000     0.112     0.006    5.3%
280000     0.114     0.004    3.5%
300000     0.112     0.003    2.6%
320000     0.117     0.004    3.4%
340000      0.11     0.002    1.8%
360000     0.112     0.006    5.3%
380000     0.108     0.003    2.7%
400000     0.107     0.003    2.8%
420000     0.114     0.003    2.6%
440000     0.117     0.004    3.4%
460000     0.112     0.004    3.5%
480000     0.107     0.004    3.7%
500000     0.111     0.004    3.6%
520000     0.107     0.003    2.8%
540000      0.11     0.004    3.6%
560000      0.11     0.001    0.9%
580000     0.121     0.005    4.1%
600000      0.11     0.003    2.7%
620000     0.106     0.001    0.9%
640000     0.109     0.003    2.7%
660000     0.117     0.003    2.5%
680000     0.107     0.006    5.6%
700000     0.111     0.004    3.6%
720000     0.109     0.002    1.8%
740000     0.114     0.006    5.2%
760000     0.111     0.003    2.7%
780000     0.107     0.003    2.8%
800000     0.114     0.004    3.5%
820000     0.107     0.003    2.8%
840000     0.118     0.004    3.3%
860000     0.107     0.002    1.8%
880000     0.116     0.003    2.5%
900000      0.11     0.003    2.7%
920000     0.109     0.004    3.6%
940000     0.116     0.003    2.5%
960000     0.109     0.005    4.5%
980000     0.113     0.004    3.5%
1000000      0.11     0.007    6.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.111
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.112     0.003    2.6%
20000     0.116     0.003    2.5%
40000     0.108     0.003    2.7%
60000     0.117     0.005    4.2%
80000     0.109     0.003    2.7%
100000     0.105     0.003    2.8%
120000     0.109     0.004    3.6%
140000      0.11     0.003    2.7%
160000     0.115     0.003    2.6%
180000     0.113     0.002    1.7%
200000     0.105     0.004    3.8%
220000     0.111     0.003    2.7%
240000     0.106     0.004    3.7%
260000      0.11     0.003    2.7%
280000     0.106     0.002    1.8%
300000     0.113     0.004    3.5%
320000     0.116     0.002    1.7%
340000      0.11     0.003    2.7%
360000     0.116     0.003    2.5%
380000     0.119     0.004    3.3%
400000     0.107     0.002    1.8%
420000     0.113     0.005    4.4%
440000      0.11     0.002    1.8%
460000     0.107     0.003    2.8%
480000     0.107     0.003    2.8%
500000     0.111     0.004    3.6%
520000      0.11     0.002    1.8%
540000     0.112     0.003    2.6%
560000     0.111     0.003    2.7%
580000     0.109     0.004    3.6%
600000     0.109     0.004    3.6%
620000     0.106     0.004    3.7%
640000     0.112     0.005    4.4%
660000     0.118     0.003    2.5%
680000     0.106     0.002    1.8%
700000     0.113     0.006    5.3%
720000     0.118     0.004    3.3%
740000     0.112     0.004    3.5%
760000     0.108     0.004    3.7%
780000     0.106     0.003    2.8%
800000     0.105     0.002    1.9%
820000     0.113     0.008    7.0%
840000     0.114     0.002    1.7%
860000     0.111     0.004    3.6%
880000     0.107     0.003    2.8%
900000     0.118     0.003    2.5%
920000     0.114     0.004    3.5%
940000     0.112     0.003    2.6%
960000     0.118     0.003    2.5%
980000     0.107     0.003    2.8%
1000000     0.113     0.002    1.7%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.111
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    19610
    + i    0.135
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     19590     35.59    0.1%
    2     19580     34.83    0.1%
    4     19580     13.05    0.0%
    6     19610     31.17    0.1%
    8     19610     40.93    0.2%
   10     19640     54.65    0.2%
   12     19610     40.94    0.2%
   14     19600     31.33    0.1%
   16     19600     22.92    0.1%
   18     19600     34.42    0.1%
   20     19590     21.52    0.1%
   22     19630      34.1    0.1%
   24     19610     29.21    0.1%
   26     19590     15.44    0.0%
   28     19590     31.97    0.1%
   30     19610     22.77    0.1%
   32     19630     33.19    0.1%
   34     19650     34.49    0.1%
   36     19660     43.98    0.2%
   38     19590     19.29    0.0%
   40     19610     19.72    0.1%
   42     19630     31.87    0.1%
   44     19650      42.3    0.2%
   46     19650     70.88    0.3%
   48     19650     35.68    0.1%
   50     19590     37.15    0.1%
   52     19590     9.478    0.0%
   54     19600     37.95    0.1%
   56     19600     30.05    0.1%
   58     19570     33.87    0.1%
   60     19710     139.7    0.7%
   62     19590     42.64    0.2%
   64     19630     57.84    0.2%
   66     19820     108.9    0.5%
   68     19620     10.94    0.0%
   70     19590     33.34    0.1%
   72     19610     18.88    0.0%
   74     19610      40.4    0.2%
   76     19610     62.02    0.3%
   78     19600     54.39    0.2%
   80     19620     52.53    0.2%
   82     19610     32.56    0.1%
   84     19670     27.72    0.1%
   86     19640     55.08    0.2%
   88     19640     27.22    0.1%
   90     19580     37.89    0.1%
   92     19600     40.28    0.2%
   94     19610     37.26    0.1%
   96     19610     38.65    0.1%
   98     19630     42.23    0.2%
  100     19600     34.44    0.1%

Quality and confidence:
param     error
i         0.088

Model:
Time ~=    19610
    + i    0.203
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "sr25519_verification", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.897
    + i    47.34
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    1     48.17     0.135    0.2%
    2     95.57     0.279    0.2%
    3     142.7     0.418    0.2%
    4     189.6     0.362    0.1%
    5     237.1     0.331    0.1%
    6     283.7     0.277    0.0%
    7     331.3      0.65    0.1%
    8     378.6     0.327    0.0%
    9     425.2     0.421    0.0%
   10     473.2      0.81    0.1%
   11     520.4     1.081    0.2%
   12     567.5     1.247    0.2%
   13     614.9     1.112    0.1%
   14     665.9      8.16    1.2%
   15     709.2     0.993    0.1%
   16       757     1.325    0.1%
   17       804     1.874    0.2%
   18     853.2     6.518    0.7%
   19     897.5     0.842    0.0%
   20     946.3     1.267    0.1%
   21      1004     10.03    0.9%
   22      1039     1.575    0.1%
   23      1085      1.04    0.0%
   24      1136     8.133    0.7%
   25      1181     4.701    0.3%
   26      1228     0.782    0.0%
   27      1279     10.38    0.8%
   28      1320     0.948    0.0%
   29      1378     13.53    0.9%
   30      1417     4.176    0.2%
   31      1472     14.91    1.0%
   32      1522     14.36    0.9%
   33      1558     1.639    0.1%
   34      1611     10.52    0.6%
   35      1665     12.25    0.7%
   36      1699     1.342    0.0%
   37      1755     12.34    0.7%
   38      1813     11.85    0.6%
   39      1865     7.645    0.4%
   40      1899     12.88    0.6%
   41      1940     11.63    0.5%
   42      1983     7.649    0.3%
   43      2064     9.306    0.4%
   44      2102     8.744    0.4%
   45      2134     12.07    0.5%
   46      2177     10.06    0.4%
   47      2224     10.84    0.4%
   48      2275     12.04    0.5%
   49      2329     12.78    0.5%
   50      2376     12.85    0.5%
   51      2426     11.81    0.4%
   52      2469     14.23    0.5%
   53      2506        11    0.4%
   54      2564     14.56    0.5%
   55      2599      9.44    0.3%
   56      2660      17.8    0.6%
   57      2706     12.32    0.4%
   58      2753     19.42    0.7%
   59      2800     15.11    0.5%
   60      2861     6.878    0.2%
   61      2893     15.94    0.5%
   62      2947      11.8    0.4%
   63      2997     12.79    0.4%
   64      3043     13.85    0.4%
   65      3090     7.151    0.2%
   66      3128     15.48    0.4%
   67      3194     16.83    0.5%
   68      3224      14.7    0.4%
   69      3270      14.7    0.4%
   70      3333     9.488    0.2%
   71      3380     14.19    0.4%
   72      3436     12.56    0.3%
   73      3466     11.13    0.3%
   74      3512     18.12    0.5%
   75      3575     12.15    0.3%
   76      3646        11    0.3%
   77      3682     11.52    0.3%
   78      3710     8.417    0.2%
   79      3749     10.27    0.2%
   80      3803     2.328    0.0%
   81      3838     12.95    0.3%
   82      3895     17.54    0.4%
   83      3938     10.31    0.2%
   84      3993     12.73    0.3%
   85      4031     21.24    0.5%
   86      4096     9.475    0.2%
   87      4141     27.32    0.6%
   88      4186     20.02    0.4%
   89      4216     20.61    0.4%
   90      4284     9.261    0.2%
   91      4319     9.357    0.2%
   92      4370     17.74    0.4%
   93      4414      18.9    0.4%
   94      4445     16.48    0.3%
   95      4510     18.38    0.4%
   96      4552      13.2    0.2%
   97      4615     20.12    0.4%
   98      4656     10.62    0.2%
   99      4706     10.34    0.2%
  100      4752     18.71    0.3%

Quality and confidence:
param     error
i         0.015

Model:
Time ~=        0
    + i    47.55
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i     1.96
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.116     0.008    6.8%
   20     32.54     0.379    1.1%
   40      61.2     0.222    0.3%
   60     94.54     0.352    0.3%
   80     123.2     0.801    0.6%
  100     157.7     0.895    0.5%
  120     194.3     0.654    0.3%
  140     226.7     0.943    0.4%
  160     266.5     2.119    0.7%
  180     298.1     1.694    0.5%
  200     333.6     1.161    0.3%
  220     367.4     2.493    0.6%
  240     411.1     2.357    0.5%
  260     447.7     1.898    0.4%
  280     486.2     2.642    0.5%
  300     525.6      2.85    0.5%
  320     567.2      2.08    0.3%
  340     606.9     4.797    0.7%
  360       645     9.438    1.4%
  380     674.9     10.75    1.5%
  400     715.4     9.848    1.3%
  420     742.7     2.125    0.2%
  440     783.3      10.5    1.3%
  460     836.1     4.943    0.5%
  480     880.2     8.938    1.0%
  500     918.3     6.386    0.6%
  520     967.2     11.34    1.1%
  540       985     5.685    0.5%
  560      1043     13.46    1.2%
  580      1079     8.491    0.7%
  600      1102     6.001    0.5%
  620      1159      11.9    1.0%
  640      1200     9.643    0.8%
  660      1232     6.511    0.5%
  680      1272     13.76    1.0%
  700      1346      4.11    0.3%
  720      1342     5.962    0.4%
  740      1387     10.06    0.7%
  760      1457     8.497    0.5%
  780      1482     14.35    0.9%
  800      1500     8.153    0.5%
  820      1548     6.564    0.4%
  840      1600      14.1    0.8%
  860      1639      8.66    0.5%
  880      1711     11.95    0.6%
  900      1745     10.27    0.5%
  920      1775     7.676    0.4%
  940      1838      12.3    0.6%
  960      1872     15.82    0.8%
  980      1918     12.34    0.6%
 1000      1967     9.369    0.4%

Quality and confidence:
param     error
i         0.003

Model:
Time ~=        0
    + i    1.973
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.318
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.117     0.003    2.5%
   20     4.685     0.022    0.4%
   40     9.709     0.082    0.8%
   60     14.51     0.077    0.5%
   80     19.24     0.054    0.2%
  100     24.31     0.094    0.3%
  120     30.04     0.262    0.8%
  140        36     0.124    0.3%
  160     41.61     0.192    0.4%
  180     47.93      0.53    1.1%
  200      52.8     0.209    0.3%
  220     58.68     0.378    0.6%
  240     63.92     0.083    0.1%
  260     69.43     0.255    0.3%
  280     75.37     0.476    0.6%
  300     80.71     0.479    0.5%
  320     86.51     0.519    0.5%
  340     93.05     0.548    0.5%
  360     98.38     0.663    0.6%
  380     105.2     0.746    0.7%
  400     111.5     0.748    0.6%
  420     117.2     0.587    0.5%
  440       125     1.171    0.9%
  460     129.1     0.571    0.4%
  480       142     1.007    0.7%
  500     143.8     0.954    0.6%
  520     148.9     0.431    0.2%
  540       157     0.336    0.2%
  560       162     0.872    0.5%
  580     168.7     1.987    1.1%
  600     179.2     3.215    1.7%
  620     182.8     1.537    0.8%
  640     195.7      4.49    2.2%
  660     195.5     2.804    1.4%
  680     205.6     2.653    1.2%
  700     217.2     2.101    0.9%
  720     220.1     2.602    1.1%
  740     228.6     2.714    1.1%
  760     236.2     3.129    1.3%
  780     243.2     2.478    1.0%
  800     246.9     5.352    2.1%
  820     258.7      0.83    0.3%
  840     258.4     4.347    1.6%
  860     266.4     3.063    1.1%
  880     274.9     5.019    1.8%
  900       283     4.178    1.4%
  920     290.4     4.221    1.4%
  940     295.1     3.779    1.2%
  960     304.9     2.174    0.7%
  980     310.9     2.195    0.7%
 1000     322.4     0.752    0.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.323
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Parity Bot and others added 2 commits January 29, 2022 13:19
cargo run --quiet --profile=production --features=runtime-benchmarks …
fe7801a 
…-- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/frame_benchmarking_baseline.rs
@ggwpez
Add weight modules
04d0eb6 
Signed-off-by: Oliver Tale-Yazdi <[email protected]>
@ggwpez ggwpez added A0-please_review Pull request needs code review. B0-silent Changes should not be mentioned in any release notes C1-low PR touches the given topic and has a low impact on builders. and removed A3-in_progress Pull request is in progress. No review needed at this stage. labels Jan 30, 2022
@ggwpez ggwpez added the D3-trivial 🧸 PR contains trivial changes in a runtime directory that do not require an audit. label Jan 30, 2022
@ggwpez ggwpez changed the title [DO NOT MERGE] Test Bench Bot Add baseline benchmarks Jan 30, 2022
ggwpez
ggwpez commented Jan 30, 2022
View reviewed changes
runtime/kusama/src/weights/frame_benchmarking_baseline.rs
/// Weight functions for `frame_benchmarking::baseline`.
pub struct WeightInfo<T>(PhantomData<T>);
impl<T: frame_system::Config> frame_benchmarking::baseline::WeightInfo for WeightInfo<T> {
fn addition(_i: u32, ) -> Weight {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ reviewers:
The ignored parameters here are a known issue; https://github.com/paritytech/substrate/issues/10638

@ggwpez ggwpez marked this pull request as ready for review January 30, 2022 14:03
@gavofyork
Copy link
Member

CI failing.

@shawntabrizi
Copy link
Member

We dont need to expose the mod since it is not used, and it will probably fix the compiler error

@shawntabrizi
Copy link
Member

bot merge

@paritytech-processbot paritytech-processbot bot merged commit 594e3b9 into master Jan 30, 2022
@paritytech-processbot paritytech-processbot bot deleted the oty-test-bench-bot branch January 30, 2022 19:37
@chevdor chevdor mentioned this pull request Feb 3, 2022
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@shawntabrizi shawntabrizi shawntabrizi approved these changes

@gavofyork gavofyork gavofyork approved these changes

Assignees

@ggwpez ggwpez

Labels
A0-please_review Pull request needs code review. B0-silent Changes should not be mentioned in any release notes C1-low PR touches the given topic and has a low impact on builders. D3-trivial 🧸 PR contains trivial changes in a runtime directory that do not require an audit.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@ggwpez @joao-paulo-parity @gavofyork @shawntabrizi