Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

Companion for Substrate #8120 #2541

Merged
merged 7 commits into from
Feb 28, 2021
Merged

Companion for Substrate #8120 #2541

merged 7 commits into from
Feb 28, 2021

Conversation

gavofyork
Copy link
Member

No description provided.

@github-actions github-actions bot added the A0-please_review Pull request needs code review. label Feb 28, 2021
@gavofyork gavofyork added A2-insubstantial Pull request requires no code review (e.g., a sub-repository hash update). A8-mergeoncegreen B0-silent Changes should not be mentioned in any release notes C1-low PR touches the given topic and has a low impact on builders. and removed A0-please_review Pull request needs code review. labels Feb 28, 2021
@gavofyork
Copy link
Member Author

/benchmark runtime polkadot frame_system

@parity-benchapp
Copy link

parity-benchapp bot commented Feb 28, 2021

Finished benchmark for branch: xlc-remark

Benchmark: Benchmark Runtime Polkadot Pallet

cargo run --release --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

Results

Compiling kusama-runtime v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/kusama)
Compiling polkadot-runtime v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/polkadot)
Compiling westend-runtime v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/westend)
Compiling rococo-runtime v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/rococo)
Compiling polkadot-runtime-parachains v0.8.0 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/parachains)
Compiling polkadot-runtime-common v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/common)
error: failed to run custom build command for kusama-runtime v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/kusama)

Caused by:
process didn't exit successfully: /home/shawntabrizi/bench-bot/git/polkadot/target/release/build/kusama-runtime-7ddacde2f7cf8c48/build-script-build (exit code: 1)
--- stdout
�[1;33mInformation that should be included in a bug report.�[0m
�[1;33mExecuting build command:�[0m "rustup" "run" "nightly" "cargo" "-Zfeatures=build_dep" "rustc" "--target=wasm32-unknown-unknown" "--manifest-path=/home/shawntabrizi/bench-bot/git/polkadot/target/release/wbuild/kusama-runtime/Cargo.toml" "--color=always" "--release"
�[1;33mUsing rustc version:�[0m rustc 1.52.0-nightly (07194ffcd 2021-02-10)

--- stderr
warning: flag -Z features has been stabilized in the 1.51 release, and is no longer necessary
The new feature resolver is now available by specifying resolver = "2" in Cargo.toml.
See https://doc.rust-lang.org/nightly/cargo/reference/features.html#feature-resolver-version-2 for more information.

�[0m�[0m�[1m�[36m Blocking�[0m waiting for file lock on package cache
�[0m�[1m�[33mwarning�[0m�[0m�[1m: function is never used: load_params�[0m
�[0m �[0m�[0m�[1m�[38;5;12m--> �[0m�[0m/home/shawntabrizi/bench-bot/git/polkadot/parachain/src/wasm_api.rs:24:15�[0m
�[0m �[0m�[0m�[1m�[38;5;12m|�[0m
�[0m�[1m�[38;5;12m24�[0m�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0mpub unsafe fn load_params(params: *const u8, len: usize)�[0m
�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m �[0m�[0m�[1m�[33m^^^^^^^^^^^�[0m
�[0m �[0m�[0m�[1m�[38;5;12m|�[0m
�[0m �[0m�[0m�[1m�[38;5;12m= �[0m�[0m�[1mnote�[0m�[0m: #[warn(dead_code)] on by default�[0m

�[0m�[1m�[33mwarning�[0m�[0m�[1m: function is never used: write_result�[0m
�[0m �[0m�[0m�[1m�[38;5;12m--> �[0m�[0m/home/shawntabrizi/bench-bot/git/polkadot/parachain/src/wasm_api.rs:37:8�[0m
�[0m �[0m�[0m�[1m�[38;5;12m|�[0m
�[0m�[1m�[38;5;12m37�[0m�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0mpub fn write_result(result: &crate::primitives::ValidationResult) -> u64 {�[0m
�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m �[0m�[0m�[1m�[33m^^^^^^^^^^^^�[0m

�[0m�[1m�[33mwarning�[0m�[0m�[1m: 2 warnings emitted�[0m

�[0m�[0m�[1m�[32m Compiling�[0m polkadot-runtime-parachains v0.8.0 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/parachains)
�[0m�[1m�[33mwarning�[0m�[0m�[1m: associated function is never used: check_consistency�[0m
�[0m �[0m�[0m�[1m�[38;5;12m--> �[0m�[0m/home/shawntabrizi/bench-bot/git/polkadot/runtime/parachains/src/configuration.rs:216:5�[0m
�[0m �[0m�[0m�[1m�[38;5;12m|�[0m
�[0m�[1m�[38;5;12m216�[0m�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m fn check_consistency(&self) {�[0m
�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m �[0m�[0m�[1m�[33m^^^^^^^^^^^^^^^^^�[0m
�[0m �[0m�[0m�[1m�[38;5;12m|�[0m
�[0m �[0m�[0m�[1m�[38;5;12m= �[0m�[0m�[1mnote�[0m�[0m: #[warn(dead_code)] on by default�[0m

�[0m�[0m�[1m�[32m Compiling�[0m polkadot-runtime-common v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/common)
�[0m�[1m�[33mwarning�[0m�[0m�[1m: 1 warning emitted�[0m

�[0m�[0m�[1m�[32m Compiling�[0m kusama-runtime v0.8.29 (/home/shawntabrizi/bench-bot/git/polkadot/runtime/kusama)
�[0m�[1m�[38;5;9merror[E0407]�[0m�[0m�[1m: method remark_with_event is not a member of trait frame_system::WeightInfo�[0m
�[0m �[0m�[0m�[1m�[38;5;12m--> �[0m�[0m/home/shawntabrizi/bench-bot/git/polkadot/runtime/kusama/src/weights/frame_system.rs:76:2�[0m
�[0m �[0m�[0m�[1m�[38;5;12m|�[0m
�[0m�[1m�[38;5;12m76�[0m�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m�[1m�[38;5;9m/�[0m�[0m �[0m�[0m fn remark_with_event(_b: u32, ) -> Weight {�[0m
�[0m�[1m�[38;5;12m77�[0m�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m�[1m�[38;5;9m|�[0m�[0m �[0m�[0m (1_317_000 as Weight)�[0m
�[0m�[1m�[38;5;12m78�[0m�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m�[1m�[38;5;9m|�[0m�[0m �[0m�[0m }�[0m
�[0m �[0m�[0m�[1m�[38;5;12m| �[0m�[0m�[1m�[38;5;9m|_____^�[0m�[0m �[0m�[0m�[1m�[38;5;9mnot a member of trait frame_system::WeightInfo�[0m

�[0m�[1m�[38;5;9merror�[0m�[0m�[1m: aborting due to previous error�[0m

�[0m�[1mFor more information about this error, try rustc --explain E0407.�[0m
�[0m�[0m�[1m�[31merror�[0m�[1m:�[0m could not compile kusama-runtime

To learn more, run the command again with --verbose.
warning: build failed, waiting for other jobs to finish...
error: build failed

@gavofyork
Copy link
Member Author

/benchmark runtime polkadot frame_system

@parity-benchapp
Copy link

parity-benchapp bot commented Feb 28, 2021

Finished benchmark for branch: xlc-remark

Benchmark: Benchmark Runtime Polkadot Pallet

cargo run --release --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

Results

Pallet: "frame_system", Extrinsic: "remark", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.351
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 1.211 0.013 1.0%
78643 1.342 0.006 0.4%
157286 1.356 0.008 0.5%
235929 1.362 0.011 0.8%
314572 1.356 0.003 0.2%
393215 1.351 0.015 1.1%
471858 1.357 0.015 1.1%
550501 1.36 0.009 0.6%
629144 1.362 0.007 0.5%
707787 1.357 0.01 0.7%
786430 1.348 0.013 0.9%
865073 1.354 0.005 0.3%
943716 1.374 0.01 0.7%
1022359 1.362 0.006 0.4%
1101002 1.37 0.013 0.9%
1179645 1.359 0.004 0.2%
1258288 1.367 0.014 1.0%
1336931 1.365 0.009 0.6%
1415574 1.37 0.005 0.3%
1494217 1.382 0.015 1.0%
1572860 1.362 0.01 0.7%
1651503 1.379 0.012 0.8%
1730146 1.379 0.014 1.0%
1808789 1.363 0.013 0.9%
1887432 1.376 0.01 0.7%
1966075 1.342 0.006 0.4%
2044718 1.359 0.011 0.8%
2123361 1.354 0.014 1.0%
2202004 1.357 0.007 0.5%
2280647 1.341 0.01 0.7%
2359290 1.339 0.009 0.6%
2437933 1.35 0.014 1.0%
2516576 1.357 0.009 0.6%
2595219 1.355 0.009 0.6%
2673862 1.353 0.01 0.7%
2752505 1.365 0.006 0.4%
2831148 1.358 0.011 0.8%
2909791 1.342 0.007 0.5%
2988434 1.351 0.014 1.0%
3067077 1.367 0.014 1.0%
3145720 1.375 0.014 1.0%
3224363 1.376 0.007 0.5%
3303006 1.393 0.011 0.7%
3381649 1.355 0.012 0.8%
3460292 1.36 0.006 0.4%
3538935 1.383 0.011 0.7%
3617578 1.359 0.011 0.8%
3696221 1.372 0.013 0.9%
3774864 1.377 0.013 0.9%
3853507 1.382 0.016 1.1%
3932150 1.367 0.009 0.6%

Quality and confidence:
param error
b 0

Model:
Time ~= 1.346
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "remark_with_event", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 3.227
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 16.05 0.139 0.8%
78643 119.4 0.361 0.3%
157286 214.2 0.509 0.2%
235929 308.9 0.508 0.1%
314572 404.1 1.256 0.3%
393215 499.3 1.396 0.2%
471858 592.4 0.654 0.1%
550501 688.3 0.916 0.1%
629144 784.1 1.975 0.2%
707787 883.8 2.848 0.3%
786430 974.2 0.681 0.0%
865073 1071 8.613 0.8%
943716 1170 8.55 0.7%
1022359 1263 8.173 0.6%
1101002 1360 9.966 0.7%
1179645 1447 0.732 0.0%
1258288 1550 8.659 0.5%
1336931 1655 10.33 0.6%
1415574 1741 8.03 0.4%
1494217 1834 4.337 0.2%
1572860 1938 10.6 0.5%
1651503 2037 13.07 0.6%
1730146 2122 9.567 0.4%
1808789 2241 8.003 0.3%
1887432 2322 11.25 0.4%
1966075 2415 9.479 0.3%
2044718 2511 13.72 0.5%
2123361 2625 9.49 0.3%
2202004 2714 13.03 0.4%
2280647 2801 13.03 0.4%
2359290 2905 10.69 0.3%
2437933 3015 9.143 0.3%
2516576 3110 3.02 0.0%
2595219 3200 8.944 0.2%
2673862 3298 13.8 0.4%
2752505 3416 7.466 0.2%
2831148 3501 10.13 0.2%
2909791 3615 4.104 0.1%
2988434 3709 11.25 0.3%
3067077 3807 12.25 0.3%
3145720 3906 10.04 0.2%
3224363 4014 7.751 0.1%
3303006 4118 6.071 0.1%
3381649 4216 8.737 0.2%
3460292 4328 10.84 0.2%
3538935 4411 5.441 0.1%
3617578 4517 7.65 0.1%
3696221 4616 6.151 0.1%
3774864 4722 12.23 0.2%
3853507 4822 4.589 0.0%
3932150 4909 5.518 0.1%

Quality and confidence:
param error
b 0

Model:
Time ~= 0
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "set_heap_pages", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.767
µs

Reads = 0
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 1.767
µs

Reads = 0
Writes = 1
Pallet: "frame_system", Extrinsic: "set_changes_trie_config", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 9.789
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 9.789
µs

Reads = 1
Writes = 2
Pallet: "frame_system", Extrinsic: "set_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.577
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.775 0.012 0.6%
20 11.32 0.061 0.5%
39 21.29 0.196 0.9%
58 30.79 0.26 0.8%
77 40.97 0.246 0.6%
96 51.57 0.18 0.3%
115 61.77 0.157 0.2%
134 71.69 0.402 0.5%
153 83.61 0.384 0.4%
172 92.92 0.317 0.3%
191 104.3 0.183 0.1%
210 114.8 0.766 0.6%
229 124 0.162 0.1%
248 135.8 0.382 0.2%
267 145.6 0.761 0.5%
286 156.3 0.541 0.3%
305 166 0.473 0.2%
324 177.5 0.695 0.3%
343 187.8 0.533 0.2%
362 198.7 0.706 0.3%
381 210.2 0.297 0.1%
400 220.7 0.37 0.1%
419 232.2 0.639 0.2%
438 243.6 1.124 0.4%
457 254.6 0.951 0.3%
476 264.6 0.933 0.3%
495 275.8 0.604 0.2%
514 287.3 1.162 0.4%
533 298.6 0.651 0.2%
552 309.3 0.838 0.2%
571 319.5 1.062 0.3%
590 331.3 1.5 0.4%
609 344.6 1.38 0.4%
628 356 1.236 0.3%
647 364.2 1.889 0.5%
666 376.1 1.54 0.4%
685 388.9 1.085 0.2%
704 401.8 1.249 0.3%
723 411.1 1.025 0.2%
742 422.5 1.58 0.3%
761 432.3 1.5 0.3%
780 446.6 1.372 0.3%
799 455.8 1.575 0.3%
818 466.7 1.293 0.2%
837 480 1.611 0.3%
856 491.4 2.082 0.4%
875 503.1 1.413 0.2%
894 511.8 0.646 0.1%
913 522.6 1.077 0.2%
932 535.8 3.181 0.5%
951 547.6 1.346 0.2%
970 558.1 1.009 0.1%
989 570.3 0.914 0.1%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.579
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.409
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.775 0.033 1.8%
20 8.532 0.037 0.4%
39 15.46 0.076 0.4%
58 22.39 0.038 0.1%
77 29.18 0.101 0.3%
96 35.94 0.081 0.2%
115 43.47 0.044 0.1%
134 51.53 0.08 0.1%
153 58.55 0.087 0.1%
172 66.72 0.136 0.2%
191 74.84 0.053 0.0%
210 81.42 0.088 0.1%
229 88.8 0.167 0.1%
248 96.76 0.278 0.2%
267 103.8 0.218 0.2%
286 111.2 0.253 0.2%
305 117.1 0.307 0.2%
324 126.1 0.306 0.2%
343 133.4 0.113 0.0%
362 141.1 0.267 0.1%
381 149.2 0.262 0.1%
400 156.1 0.229 0.1%
419 163.7 0.137 0.0%
438 171.5 0.266 0.1%
457 179.9 0.213 0.1%
476 188 0.351 0.1%
495 195.2 0.248 0.1%
514 202.6 0.408 0.2%
533 212.3 0.508 0.2%
552 218 0.362 0.1%
571 225.1 0.317 0.1%
590 234.5 0.424 0.1%
609 242.6 0.404 0.1%
628 250 0.351 0.1%
647 258.1 0.217 0.0%
666 265.4 0.393 0.1%
685 274.2 0.158 0.0%
704 283.4 0.707 0.2%
723 291.4 0.233 0.0%
742 299.9 0.474 0.1%
761 306.1 1.013 0.3%
780 316.9 0.421 0.1%
799 321.7 0.616 0.1%
818 330.9 0.245 0.0%
837 340.6 0.661 0.1%
856 348.6 0.733 0.2%
875 357.6 0.54 0.1%
894 364.2 0.732 0.2%
913 372.7 0.431 0.1%
932 380.4 0.313 0.0%
951 393.5 6.737 1.7%
970 398.5 1.084 0.2%
989 406.1 0.606 0.1%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.411
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_prefix", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ p 0.837
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
1 4.599 0.036 0.7%
20 19.46 0.11 0.5%
39 34.43 0.091 0.2%
58 50.81 0.126 0.2%
77 61.8 0.168 0.2%
96 77.37 0.216 0.2%
115 91.94 0.167 0.1%
134 107.3 0.179 0.1%
153 122.1 0.289 0.2%
172 138.9 0.211 0.1%
191 153.9 0.386 0.2%
210 169.4 0.423 0.2%
229 187.5 0.31 0.1%
248 198.9 0.42 0.2%
267 215.5 0.393 0.1%
286 229.8 0.417 0.1%
305 244.2 0.599 0.2%
324 266.9 0.671 0.2%
343 278.1 0.48 0.1%
362 297 0.695 0.2%
381 317 0.547 0.1%
400 326.7 0.502 0.1%
419 345.1 0.674 0.1%
438 367.8 0.819 0.2%
457 375.3 0.723 0.1%
476 396.9 0.562 0.1%
495 412.4 0.611 0.1%
514 424 0.687 0.1%
533 447 0.799 0.1%
552 460.5 0.94 0.2%
571 474 1.136 0.2%
590 493.1 1.002 0.2%
609 501.1 1.332 0.2%
628 529.1 1.319 0.2%
647 547.8 0.648 0.1%
666 554.9 0.467 0.0%
685 577.3 1.183 0.2%
704 598.2 3.853 0.6%
723 592.1 0.57 0.0%
742 619.6 1.011 0.1%
761 639.9 1.628 0.2%
780 647.9 0.972 0.1%
799 663.4 1.241 0.1%
818 681.2 1.008 0.1%
837 695.7 1.532 0.2%
856 717.1 1.573 0.2%
875 725.2 1.351 0.1%
894 740.8 1.271 0.1%
913 758.9 1.454 0.1%
932 773.2 1.38 0.1%
951 794.5 2.378 0.2%
970 812.2 1.975 0.2%
989 813.8 1.652 0.2%

Quality and confidence:
param error
p 0

Model:
Time ~= 0
+ p 0.836
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)

…n=polkadot-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/
@gavofyork
Copy link
Member Author

/benchmark runtime polkadot frame_system

@parity-benchapp
Copy link

parity-benchapp bot commented Feb 28, 2021

Finished benchmark for branch: xlc-remark

Benchmark: Benchmark Runtime Polkadot Pallet

cargo run --release --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

Results

Pallet: "frame_system", Extrinsic: "remark", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.333
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 1.211 0.009 0.7%
78643 1.308 0.014 1.0%
157286 1.323 0.007 0.5%
235929 1.338 0.008 0.5%
314572 1.331 0.015 1.1%
393215 1.374 0.005 0.3%
471858 1.332 0.011 0.8%
550501 1.329 0.009 0.6%
629144 1.334 0.015 1.1%
707787 1.366 0.017 1.2%
786430 1.374 0.007 0.5%
865073 1.379 0.011 0.7%
943716 1.381 0.011 0.7%
1022359 1.368 0.012 0.8%
1101002 1.366 0.013 0.9%
1179645 1.374 0.011 0.8%
1258288 1.375 0.006 0.4%
1336931 1.388 0.009 0.6%
1415574 1.378 0.008 0.5%
1494217 1.368 0.008 0.5%
1572860 1.35 0.012 0.8%
1651503 1.335 0.009 0.6%
1730146 1.334 0.017 1.2%
1808789 1.347 0.02 1.4%
1887432 1.333 0.018 1.3%
1966075 1.316 0.016 1.2%
2044718 1.337 0.016 1.1%
2123361 1.339 0.01 0.7%
2202004 1.361 0.01 0.7%
2280647 1.379 0.016 1.1%
2359290 1.36 0.02 1.4%
2437933 1.354 0.01 0.7%
2516576 1.345 0.01 0.7%
2595219 1.358 0.013 0.9%
2673862 1.365 0.021 1.5%
2752505 1.383 0.012 0.8%
2831148 1.357 0.011 0.8%
2909791 1.365 0.021 1.5%
2988434 1.387 0.013 0.9%
3067077 1.384 0.01 0.7%
3145720 1.389 0.02 1.4%
3224363 1.386 0.012 0.8%
3303006 1.384 0.013 0.9%
3381649 1.374 0.007 0.5%
3460292 1.389 0.015 1.0%
3538935 1.401 0.02 1.4%
3617578 1.388 0.005 0.3%
3696221 1.402 0.01 0.7%
3774864 1.411 0.022 1.5%
3853507 1.419 0.016 1.1%
3932150 1.409 0.008 0.5%

Quality and confidence:
param error
b 0

Model:
Time ~= 1.326
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "remark_with_event", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 3.607
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 15.75 0.107 0.6%
78643 119.6 0.462 0.3%
157286 213.7 0.278 0.1%
235929 308.8 0.294 0.0%
314572 404.1 1.012 0.2%
393215 498.8 0.672 0.1%
471858 594.4 0.47 0.0%
550501 688.9 0.668 0.0%
629144 784.3 1.705 0.2%
707787 879.6 0.694 0.0%
786430 978.9 8.126 0.8%
865073 1070 2.418 0.2%
943716 1168 7.215 0.6%
1022359 1260 1.125 0.0%
1101002 1355 4.269 0.3%
1179645 1453 4.08 0.2%
1258288 1549 10.63 0.6%
1336931 1653 11.67 0.7%
1415574 1751 12.39 0.7%
1494217 1848 14.56 0.7%
1572860 1928 1.758 0.0%
1651503 2032 11.44 0.5%
1730146 2129 11.02 0.5%
1808789 2235 13.1 0.5%
1887432 2325 14.55 0.6%
1966075 2419 10.54 0.4%
2044718 2519 14.33 0.5%
2123361 2627 12.84 0.4%
2202004 2732 7.765 0.2%
2280647 2821 9.79 0.3%
2359290 2911 12.62 0.4%
2437933 3008 15.44 0.5%
2516576 3116 13.05 0.4%
2595219 3203 13.82 0.4%
2673862 3315 11.85 0.3%
2752505 3420 4.67 0.1%
2831148 3508 11.34 0.3%
2909791 3607 10.89 0.3%
2988434 3710 10.52 0.2%
3067077 3822 9.545 0.2%
3145720 3914 11.15 0.2%
3224363 4017 13.24 0.3%
3303006 4116 11.12 0.2%
3381649 4231 10.06 0.2%
3460292 4316 13.84 0.3%
3538935 4416 4.085 0.0%
3617578 4528 6.967 0.1%
3696221 4623 6.094 0.1%
3774864 4723 5.193 0.1%
3853507 4820 14.77 0.3%
3932150 4920 10.54 0.2%

Quality and confidence:
param error
b 0

Model:
Time ~= 0
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "set_heap_pages", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.849
µs

Reads = 0
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 1.849
µs

Reads = 0
Writes = 1
Pallet: "frame_system", Extrinsic: "set_changes_trie_config", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 9.961
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 9.961
µs

Reads = 1
Writes = 2
Pallet: "frame_system", Extrinsic: "set_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.569
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.787 0.019 1.0%
20 11.23 0.039 0.3%
39 20.74 0.064 0.3%
58 30.4 0.063 0.2%
77 40.8 0.09 0.2%
96 50.47 0.085 0.1%
115 60.62 0.084 0.1%
134 71.15 0.125 0.1%
153 81.76 0.142 0.1%
172 91.56 0.123 0.1%
191 103 0.173 0.1%
210 112.2 0.104 0.0%
229 122.5 0.133 0.1%
248 132.8 0.301 0.2%
267 142.6 0.487 0.3%
286 153.9 0.269 0.1%
305 163.2 0.305 0.1%
324 175.3 0.409 0.2%
343 185.3 0.283 0.1%
362 195.3 0.222 0.1%
381 207.1 0.402 0.1%
400 216.8 0.278 0.1%
419 227.7 0.268 0.1%
438 239.3 0.218 0.0%
457 249.8 0.282 0.1%
476 262 0.705 0.2%
495 271.6 1.112 0.4%
514 281.6 0.886 0.3%
533 294.3 0.414 0.1%
552 304 0.841 0.2%
571 314.6 0.679 0.2%
590 327.1 1.75 0.5%
609 336.9 0.752 0.2%
628 351.3 2.127 0.6%
647 358.5 0.299 0.0%
666 371.5 1.995 0.5%
685 384.1 1.382 0.3%
704 395.3 0.781 0.1%
723 403.8 0.93 0.2%
742 416.5 0.78 0.1%
761 426.6 1.559 0.3%
780 440.6 1.306 0.2%
799 447.4 1.118 0.2%
818 461.7 5.637 1.2%
837 473.1 0.9 0.1%
856 483.3 0.795 0.1%
875 494.9 1.459 0.2%
894 503.9 0.774 0.1%
913 516.5 1.265 0.2%
932 527.7 5.659 1.0%
951 539.4 1.471 0.2%
970 549.4 0.818 0.1%
989 562.6 0.991 0.1%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.57
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.414
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.796 0.018 1.0%
20 8.682 0.064 0.7%
39 15.89 0.087 0.5%
58 22.92 0.105 0.4%
77 29.71 0.185 0.6%
96 36.92 0.131 0.3%
115 44.53 0.244 0.5%
134 52.26 0.258 0.4%
153 59.32 0.484 0.8%
172 66.68 0.375 0.5%
191 75.13 0.256 0.3%
210 82.56 0.517 0.6%
229 89.32 0.691 0.7%
248 98.19 0.333 0.3%
267 105.2 0.45 0.4%
286 112.3 0.651 0.5%
305 119.4 0.828 0.6%
324 128.4 0.772 0.6%
343 136 0.807 0.5%
362 142.3 0.474 0.3%
381 151.1 0.848 0.5%
400 158.6 0.947 0.5%
419 167.1 1.184 0.7%
438 175.3 1.13 0.6%
457 182.8 1.241 0.6%
476 191.6 0.824 0.4%
495 197.9 0.874 0.4%
514 206 1.211 0.5%
533 215.9 1.377 0.6%
552 222 1.414 0.6%
571 228.9 0.998 0.4%
590 237.3 1.267 0.5%
609 245.5 1.154 0.4%
628 254.7 1.5 0.5%
647 263.7 1.926 0.7%
666 272.4 1.245 0.4%
685 278.4 1.484 0.5%
704 287.6 1.64 0.5%
723 295.3 1.372 0.4%
742 304.5 1.916 0.6%
761 310.7 1.561 0.5%
780 320.3 2.045 0.6%
799 325.4 2.232 0.6%
818 334.7 1.728 0.5%
837 344.5 2.075 0.6%
856 354 1.975 0.5%
875 363.1 2.191 0.6%
894 368 1.472 0.3%
913 377.8 1.758 0.4%
932 384.7 2.128 0.5%
951 392.3 0.971 0.2%
970 403.4 2.223 0.5%
989 412.6 2.067 0.5%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.416
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_prefix", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ p 0.858
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
1 4.553 0.036 0.7%
20 19.7 0.132 0.6%
39 34.84 0.112 0.3%
58 52 0.177 0.3%
77 63.35 0.207 0.3%
96 79.08 0.129 0.1%
115 93.84 0.201 0.2%
134 109.6 0.306 0.2%
153 125.7 0.259 0.2%
172 142.5 0.213 0.1%
191 157.9 0.409 0.2%
210 173.8 0.403 0.2%
229 192.8 0.512 0.2%
248 204.1 0.45 0.2%
267 220.3 0.331 0.1%
286 235.5 0.401 0.1%
305 250 0.747 0.2%
324 273.9 0.603 0.2%
343 285 0.425 0.1%
362 305.5 0.75 0.2%
381 325 0.576 0.1%
400 334.9 0.656 0.1%
419 354 0.703 0.1%
438 376.6 0.992 0.2%
457 385.2 0.37 0.0%
476 408.9 0.684 0.1%
495 422.3 0.957 0.2%
514 436.4 0.718 0.1%
533 458 0.804 0.1%
552 472.4 0.711 0.1%
571 484.9 1.393 0.2%
590 507.8 1.92 0.3%
609 526.2 5.049 0.9%
628 552.2 11.15 2.0%
647 574.6 10.49 1.8%
666 581.5 8.661 1.4%
685 590.7 0.753 0.1%
704 610.2 0.974 0.1%
723 607 1.318 0.2%
742 637.6 1.119 0.1%
761 654.9 1.168 0.1%
780 663.9 1.843 0.2%
799 679.2 1.324 0.1%
818 693.9 0.929 0.1%
837 715.1 1.121 0.1%
856 735.4 1.489 0.2%
875 742 1.402 0.1%
894 757.5 0.756 0.0%
913 780.7 4.374 0.5%
932 794.5 1.154 0.1%
951 813 2.029 0.2%
970 832.9 1.915 0.2%
989 838.8 5.121 0.6%

Quality and confidence:
param error
p 0.001

Model:
Time ~= 0
+ p 0.859
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)

@gavofyork
Copy link
Member Author

/benchmark runtime kusama frame_system

@gavofyork
Copy link
Member Author

/benchmark runtime westend frame_system

…n=polkadot-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/
@parity-benchapp
Copy link

parity-benchapp bot commented Feb 28, 2021

Finished benchmark for branch: xlc-remark

Benchmark: Benchmark Runtime Westend Pallet

cargo run --release --features=runtime-benchmarks -- benchmark --chain=westend-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/westend/src/weights/

Results

Pallet: "frame_system", Extrinsic: "remark", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.263
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 1.09 0.011 1.0%
78643 1.231 0.014 1.1%
157286 1.259 0.008 0.6%
235929 1.247 0.008 0.6%
314572 1.264 0.016 1.2%
393215 1.266 0.005 0.3%
471858 1.279 0.008 0.6%
550501 1.285 0.018 1.4%
629144 1.288 0.01 0.7%
707787 1.28 0.006 0.4%
786430 1.279 0.009 0.7%
865073 1.28 0.009 0.7%
943716 1.307 0.01 0.7%
1022359 1.286 0.009 0.6%
1101002 1.286 0.008 0.6%
1179645 1.297 0.006 0.4%
1258288 1.315 0.006 0.4%
1336931 1.306 0.011 0.8%
1415574 1.302 0.009 0.6%
1494217 1.308 0.011 0.8%
1572860 1.303 0.006 0.4%
1651503 1.285 0.009 0.7%
1730146 1.281 0.011 0.8%
1808789 1.277 0.009 0.7%
1887432 1.264 0.015 1.1%
1966075 1.276 0.006 0.4%
2044718 1.285 0.007 0.5%
2123361 1.275 0.006 0.4%
2202004 1.303 0.008 0.6%
2280647 1.272 0.01 0.7%
2359290 1.276 0.008 0.6%
2437933 1.296 0.012 0.9%
2516576 1.275 0.006 0.4%
2595219 1.309 0.012 0.9%
2673862 1.299 0.012 0.9%
2752505 1.278 0.008 0.6%
2831148 1.302 0.006 0.4%
2909791 1.314 0.012 0.9%
2988434 1.3 0.007 0.5%
3067077 1.318 0.014 1.0%
3145720 1.294 0.011 0.8%
3224363 1.287 0.013 1.0%
3303006 1.308 0.019 1.4%
3381649 1.286 0.013 1.0%
3460292 1.302 0.007 0.5%
3538935 1.31 0.005 0.3%
3617578 1.332 0.008 0.6%
3696221 1.327 0.01 0.7%
3774864 1.31 0.019 1.4%
3853507 1.33 0.012 0.9%
3932150 1.341 0.008 0.5%

Quality and confidence:
param error
b 0

Model:
Time ~= 1.253
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "remark_with_event", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 2.765
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 15.25 0.038 0.2%
78643 119.3 0.334 0.2%
157286 213.9 0.236 0.1%
235929 308.6 0.245 0.0%
314572 404.1 0.191 0.0%
393215 497.5 0.538 0.1%
471858 593 0.443 0.0%
550501 688.5 0.373 0.0%
629144 784.2 2.043 0.2%
707787 880.5 0.609 0.0%
786430 975 0.681 0.0%
865073 1071 1.984 0.1%
943716 1168 8.764 0.7%
1022359 1260 2.029 0.1%
1101002 1356 1.603 0.1%
1179645 1449 1.358 0.0%
1258288 1546 1.367 0.0%
1336931 1649 12.79 0.7%
1415574 1751 15.75 0.8%
1494217 1851 14.52 0.7%
1572860 1930 5.854 0.3%
1651503 2035 11.61 0.5%
1730146 2122 8.371 0.3%
1808789 2222 10.66 0.4%
1887432 2331 11.49 0.4%
1966075 2415 10.83 0.4%
2044718 2513 13.31 0.5%
2123361 2611 11.06 0.4%
2202004 2718 13.11 0.4%
2280647 2803 12.25 0.4%
2359290 2906 14.54 0.5%
2437933 3012 13.14 0.4%
2516576 3103 10.92 0.3%
2595219 3196 10.88 0.3%
2673862 3305 13.52 0.4%
2752505 3403 7.448 0.2%
2831148 3500 8.265 0.2%
2909791 3598 10.22 0.2%
2988434 3695 14.53 0.3%
3067077 3816 11.66 0.3%
3145720 3914 13.79 0.3%
3224363 4007 8.893 0.2%
3303006 4112 9.354 0.2%
3381649 4214 7.557 0.1%
3460292 4318 6.275 0.1%
3538935 4414 14 0.3%
3617578 4520 12.78 0.2%
3696221 4620 6.752 0.1%
3774864 4732 10.71 0.2%
3853507 4829 9.896 0.2%
3932150 4923 11.64 0.2%

Quality and confidence:
param error
b 0

Model:
Time ~= 0
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "set_heap_pages", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.648
µs

Reads = 0
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 1.648
µs

Reads = 0
Writes = 1
Pallet: "frame_system", Extrinsic: "set_changes_trie_config", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 8.75
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 8.75
µs

Reads = 1
Writes = 2
Pallet: "frame_system", Extrinsic: "set_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.568
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.743 0.013 0.7%
20 11.13 0.08 0.7%
39 20.64 0.045 0.2%
58 30.1 0.065 0.2%
77 40.43 0.07 0.1%
96 50.08 0.129 0.2%
115 61.39 0.247 0.4%
134 70.47 0.187 0.2%
153 80.57 0.127 0.1%
172 90.8 0.07 0.0%
191 102.1 0.14 0.1%
210 111.3 0.124 0.1%
229 121.8 0.236 0.1%
248 132.5 0.471 0.3%
267 143 0.261 0.1%
286 153.5 0.188 0.1%
305 162 0.268 0.1%
324 175 0.466 0.2%
343 185 0.338 0.1%
362 194.8 0.424 0.2%
381 206.5 1.235 0.5%
400 215.8 0.58 0.2%
419 227.3 0.665 0.2%
438 239.2 0.782 0.3%
457 249.4 0.25 0.1%
476 260.5 0.358 0.1%
495 269.5 0.411 0.1%
514 280.3 1.108 0.3%
533 293 0.936 0.3%
552 302.7 1.053 0.3%
571 312.8 0.777 0.2%
590 324.6 0.409 0.1%
609 335.6 1.357 0.4%
628 347.2 0.718 0.2%
647 356 0.381 0.1%
666 370.5 0.965 0.2%
685 381.2 1.255 0.3%
704 391.8 1.213 0.3%
723 402.7 1.116 0.2%
742 416.5 1.905 0.4%
761 425.3 1.73 0.4%
780 441.1 4.557 1.0%
799 446 0.811 0.1%
818 458.2 1.195 0.2%
837 470.8 0.843 0.1%
856 482.1 1.457 0.3%
875 493.2 0.755 0.1%
894 506 1.215 0.2%
913 531.5 6.292 1.1%
932 536.9 1.755 0.3%
951 552 0.991 0.1%
970 564.6 2.841 0.5%
989 585.7 10.34 1.7%

Quality and confidence:
param error
i 0.001

Model:
Time ~= 0
+ i 0.577
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.416
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.739 0.02 1.1%
20 8.675 0.04 0.4%
39 15.71 0.051 0.3%
58 22.61 0.058 0.2%
77 29.73 0.082 0.2%
96 36.73 0.047 0.1%
115 44.13 0.069 0.1%
134 52.04 0.104 0.1%
153 58.94 0.04 0.0%
172 67.47 0.129 0.1%
191 75.24 0.106 0.1%
210 81.66 0.097 0.1%
229 89.22 0.204 0.2%
248 98.14 0.305 0.3%
267 105.2 0.139 0.1%
286 112 0.237 0.2%
305 118.5 0.323 0.2%
324 127.8 0.363 0.2%
343 135.4 0.217 0.1%
362 142.9 0.364 0.2%
381 152.3 0.372 0.2%
400 158.6 0.301 0.1%
419 165.9 0.179 0.1%
438 174.4 0.249 0.1%
457 181.4 0.322 0.1%
476 189.2 0.17 0.0%
495 197.2 0.507 0.2%
514 205.4 0.153 0.0%
533 220.1 0.314 0.1%
552 226.7 0.473 0.2%
571 234.7 0.513 0.2%
590 239.7 1.933 0.8%
609 246.3 0.711 0.2%
628 254.6 0.354 0.1%
647 261.9 0.221 0.0%
666 270.5 0.207 0.0%
685 278.8 0.33 0.1%
704 287.6 0.698 0.2%
723 295.3 0.763 0.2%
742 303.7 0.352 0.1%
761 311.1 0.746 0.2%
780 320.4 0.309 0.0%
799 326.2 0.532 0.1%
818 336 0.799 0.2%
837 345.5 0.485 0.1%
856 353.9 0.412 0.1%
875 362.6 0.472 0.1%
894 369 0.363 0.0%
913 377.3 0.322 0.0%
932 386 0.703 0.1%
951 395.9 0.656 0.1%
970 403.7 0.735 0.1%
989 412.2 0.634 0.1%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.417
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_prefix", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ p 0.848
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
1 4.448 0.068 1.5%
20 19.56 0.161 0.8%
39 34.84 0.084 0.2%
58 51.24 0.154 0.3%
77 62.75 0.174 0.2%
96 78.3 0.097 0.1%
115 92.35 0.196 0.2%
134 108.3 0.19 0.1%
153 123.6 0.155 0.1%
172 140.2 0.376 0.2%
191 155.4 0.186 0.1%
210 172.6 0.568 0.3%
229 189.9 0.344 0.1%
248 200.4 0.29 0.1%
267 219.6 0.64 0.2%
286 233.3 0.232 0.0%
305 246.8 0.426 0.1%
324 270.5 0.272 0.1%
343 282.5 0.515 0.1%
362 301.1 0.346 0.1%
381 320.3 0.857 0.2%
400 331.7 0.722 0.2%
419 349.5 0.774 0.2%
438 371.5 0.815 0.2%
457 381 0.897 0.2%
476 403.1 0.779 0.1%
495 416.6 0.612 0.1%
514 429.8 0.709 0.1%
533 451.8 0.972 0.2%
552 466.3 1.524 0.3%
571 482.6 0.934 0.1%
590 498.9 0.847 0.1%
609 506.1 1.337 0.2%
628 532.3 1.012 0.1%
647 554.1 0.618 0.1%
666 563.1 1.556 0.2%
685 581.1 1.783 0.3%
704 602.7 1.119 0.1%
723 600.5 0.92 0.1%
742 626.6 0.975 0.1%
761 644.2 0.729 0.1%
780 655.4 1.397 0.2%
799 670.6 1.447 0.2%
818 691 2.924 0.4%
837 706.3 1.834 0.2%
856 723.9 1.204 0.1%
875 739.8 7.814 1.0%
894 750.2 0.732 0.0%
913 768.9 2.186 0.2%
932 785.6 0.826 0.1%
951 807.1 1.728 0.2%
970 825.9 5.019 0.6%
989 826.6 4.523 0.5%

Quality and confidence:
param error
p 0

Model:
Time ~= 0
+ p 0.848
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)

…n=westend-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/westend/src/weights/
@parity-benchapp
Copy link

parity-benchapp bot commented Feb 28, 2021

Finished benchmark for branch: xlc-remark

Benchmark: Benchmark Runtime Kusama Pallet

cargo run --release --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/

Results

Pallet: "frame_system", Extrinsic: "remark", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.228
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 1.075 0.008 0.7%
78643 1.255 0.02 1.5%
157286 1.272 0.02 1.5%
235929 1.271 0.009 0.7%
314572 1.235 0.012 0.9%
393215 1.24 0.01 0.8%
471858 1.242 0.004 0.3%
550501 1.24 0.005 0.4%
629144 1.24 0.004 0.3%
707787 1.233 0.015 1.2%
786430 1.249 0.012 0.9%
865073 1.239 0.01 0.8%
943716 1.233 0.01 0.8%
1022359 1.246 0.012 0.9%
1101002 1.244 0.009 0.7%
1179645 1.24 0.009 0.7%
1258288 1.241 0.01 0.8%
1336931 1.243 0.015 1.2%
1415574 1.263 0.006 0.4%
1494217 1.273 0.021 1.6%
1572860 1.27 0.006 0.4%
1651503 1.24 0.008 0.6%
1730146 1.246 0.008 0.6%
1808789 1.243 0.006 0.4%
1887432 1.246 0.012 0.9%
1966075 1.248 0.01 0.8%
2044718 1.24 0.007 0.5%
2123361 1.25 0.008 0.6%
2202004 1.241 0.011 0.8%
2280647 1.263 0.008 0.6%
2359290 1.245 0.008 0.6%
2437933 1.237 0.009 0.7%
2516576 1.239 0.008 0.6%
2595219 1.24 0.013 1.0%
2673862 1.249 0.011 0.8%
2752505 1.253 0.012 0.9%
2831148 1.276 0.011 0.8%
2909791 1.277 0.014 1.0%
2988434 1.28 0.013 1.0%
3067077 1.265 0.02 1.5%
3145720 1.265 0.009 0.7%
3224363 1.26 0.014 1.1%
3303006 1.283 0.016 1.2%
3381649 1.278 0.013 1.0%
3460292 1.27 0.008 0.6%
3538935 1.265 0.008 0.6%
3617578 1.284 0.009 0.7%
3696221 1.306 0.017 1.3%
3774864 1.294 0.02 1.5%
3853507 1.299 0.008 0.6%
3932150 1.319 0.019 1.4%

Quality and confidence:
param error
b 0

Model:
Time ~= 1.222
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "remark_with_event", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 2.988
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 15.61 0.08 0.5%
78643 119.9 0.788 0.6%
157286 214.1 0.126 0.0%
235929 308.6 0.258 0.0%
314572 403.8 0.356 0.0%
393215 498.8 0.334 0.0%
471858 593.4 0.426 0.0%
550501 688.2 1.1 0.1%
629144 782.2 0.966 0.1%
707787 880.5 1.773 0.2%
786430 977.7 8.283 0.8%
865073 1075 10.57 0.9%
943716 1165 2.27 0.1%
1022359 1265 10.88 0.8%
1101002 1358 9.355 0.6%
1179645 1452 7.646 0.5%
1258288 1546 7.959 0.5%
1336931 1644 7.112 0.4%
1415574 1746 11.08 0.6%
1494217 1848 10.56 0.5%
1572860 1931 7.121 0.3%
1651503 2032 13.82 0.6%
1730146 2127 11.63 0.5%
1808789 2219 10.24 0.4%
1887432 2325 11.98 0.5%
1966075 2431 4.072 0.1%
2044718 2517 11.47 0.4%
2123361 2623 12.14 0.4%
2202004 2719 6.349 0.2%
2280647 2816 7.971 0.2%
2359290 2904 10.53 0.3%
2437933 3002 9.234 0.3%
2516576 3107 10.88 0.3%
2595219 3196 11.09 0.3%
2673862 3300 13.47 0.4%
2752505 3395 7.014 0.2%
2831148 3503 5.944 0.1%
2909791 3598 8.905 0.2%
2988434 3697 10.41 0.2%
3067077 3804 9.401 0.2%
3145720 3894 7.779 0.1%
3224363 4029 52.62 1.3%
3303006 4201 4.301 0.1%
3381649 4293 2.638 0.0%
3460292 4396 8.822 0.2%
3538935 4426 12.94 0.2%
3617578 4516 13.64 0.3%
3696221 4616 7.747 0.1%
3774864 4708 6.467 0.1%
3853507 4825 8.144 0.1%
3932150 4914 6.699 0.1%

Quality and confidence:
param error
b 0

Model:
Time ~= 0
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "set_heap_pages", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.675
µs

Reads = 0
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 1.675
µs

Reads = 0
Writes = 1
Pallet: "frame_system", Extrinsic: "set_changes_trie_config", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 9.696
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 9.696
µs

Reads = 1
Writes = 2
Pallet: "frame_system", Extrinsic: "set_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.574
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.631 0.015 0.9%
20 11.04 0.057 0.5%
39 20.54 0.084 0.4%
58 30.27 0.07 0.2%
77 40.45 0.225 0.5%
96 50.66 0.121 0.2%
115 61.27 0.137 0.2%
134 71.13 0.075 0.1%
153 82.61 0.14 0.1%
172 92.5 0.168 0.1%
191 102.8 0.098 0.0%
210 112.6 0.243 0.2%
229 122.7 0.12 0.0%
248 134.5 0.193 0.1%
267 143.5 0.342 0.2%
286 154.9 0.243 0.1%
305 163.6 0.221 0.1%
324 175.5 0.09 0.0%
343 186.3 0.306 0.1%
362 196.5 0.301 0.1%
381 207 0.126 0.0%
400 218.3 0.271 0.1%
419 227.6 0.505 0.2%
438 239.3 0.557 0.2%
457 251.5 0.309 0.1%
476 262.4 0.311 0.1%
495 272.8 0.407 0.1%
514 283.7 0.83 0.2%
533 297.1 0.837 0.2%
552 305.2 0.848 0.2%
571 316.6 0.684 0.2%
590 327.6 0.74 0.2%
609 339.6 1.311 0.3%
628 350.5 1.096 0.3%
647 362.9 1.617 0.4%
666 371 1.21 0.3%
685 383.4 1.212 0.3%
704 396 1.298 0.3%
723 407 1 0.2%
742 420.3 1.34 0.3%
761 429.2 1.366 0.3%
780 441.9 1.64 0.3%
799 451.8 1.102 0.2%
818 463.2 1.154 0.2%
837 476 1.006 0.2%
856 487.6 1.402 0.2%
875 499.7 2.03 0.4%
894 510 1.098 0.2%
913 520 1.098 0.2%
932 531.7 1.185 0.2%
951 553 12.97 2.3%
970 556.3 3.656 0.6%
989 572 8.17 1.4%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.577
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.407
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.588 0.023 1.4%
20 8.338 0.052 0.6%
39 15.07 0.048 0.3%
58 21.97 0.052 0.2%
77 28.86 0.067 0.2%
96 35.64 0.052 0.1%
115 43.07 0.071 0.1%
134 50.5 0.077 0.1%
153 57.54 0.103 0.1%
172 66.32 0.138 0.2%
191 74.26 0.114 0.1%
210 80.5 0.104 0.1%
229 87.35 0.234 0.2%
248 95.19 0.205 0.2%
267 103.1 0.176 0.1%
286 110.4 0.206 0.1%
305 116.4 0.158 0.1%
324 125.1 0.128 0.1%
343 133.6 0.173 0.1%
362 140.7 0.137 0.0%
381 148.5 0.184 0.1%
400 155.3 0.149 0.0%
419 162.3 0.188 0.1%
438 170.5 0.33 0.1%
457 178.7 0.199 0.1%
476 187.3 0.222 0.1%
495 193.9 0.368 0.1%
514 201.6 0.23 0.1%
533 211.3 0.796 0.3%
552 217.1 0.406 0.1%
571 224.2 0.237 0.1%
590 232.6 0.363 0.1%
609 241 0.481 0.1%
628 249 0.27 0.1%
647 256.4 0.46 0.1%
666 263.3 0.377 0.1%
685 272.5 0.552 0.2%
704 280.3 0.316 0.1%
723 288.7 0.611 0.2%
742 297.3 0.302 0.1%
761 304 0.932 0.3%
780 315.3 0.697 0.2%
799 319.8 0.706 0.2%
818 328.8 0.65 0.1%
837 338.9 0.89 0.2%
856 348.4 0.844 0.2%
875 357 0.674 0.1%
894 363.2 0.38 0.1%
913 371.8 0.547 0.1%
932 379.5 0.732 0.1%
951 389.5 0.433 0.1%
970 396.4 0.735 0.1%
989 404.9 0.501 0.1%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.409
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_prefix", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ p 0.843
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
1 4.427 0.059 1.3%
20 19.34 0.098 0.5%
39 34.34 0.088 0.2%
58 51.16 0.169 0.3%
77 62.19 0.113 0.1%
96 78.09 0.176 0.2%
115 91.59 0.168 0.1%
134 108.2 0.198 0.1%
153 122.7 0.276 0.2%
172 139.9 0.315 0.2%
191 155.5 0.265 0.1%
210 171.7 0.955 0.5%
229 189.5 0.503 0.2%
248 200.3 0.324 0.1%
267 217.5 0.329 0.1%
286 233.1 0.32 0.1%
305 246.1 0.609 0.2%
324 269.1 0.704 0.2%
343 280.6 0.508 0.1%
362 299.8 0.408 0.1%
381 318.6 0.704 0.2%
400 330 0.652 0.1%
419 347.8 0.501 0.1%
438 369.4 0.372 0.1%
457 379.2 0.844 0.2%
476 401.1 0.718 0.1%
495 415.3 0.89 0.2%
514 428 1.082 0.2%
533 447.9 0.52 0.1%
552 463.8 1.476 0.3%
571 479.2 1.45 0.3%
590 498 0.885 0.1%
609 502.7 0.91 0.1%
628 531.6 0.396 0.0%
647 552.6 0.892 0.1%
666 559.4 0.97 0.1%
685 577.7 0.94 0.1%
704 598.2 0.983 0.1%
723 595.4 1.269 0.2%
742 625.9 1.635 0.2%
761 641.3 0.93 0.1%
780 657.4 7.929 1.2%
799 666.2 0.684 0.1%
818 683 1.231 0.1%
837 701.1 0.95 0.1%
856 723.5 1.373 0.1%
875 729.7 1.396 0.1%
894 748.4 0.859 0.1%
913 763.3 0.905 0.1%
932 779.7 1.722 0.2%
951 801.8 1.235 0.1%
970 819 1.211 0.1%
989 822.8 4.222 0.5%

Quality and confidence:
param error
p 0

Model:
Time ~= 0
+ p 0.843
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)

…n=kusama-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/
@shawntabrizi shawntabrizi merged commit 69bb195 into master Feb 28, 2021
@shawntabrizi shawntabrizi deleted the xlc-remark branch February 28, 2021 15:13
@clearloop
Copy link

/benchmark runtime westend frame_system

@parity-benchapp
Copy link

parity-benchapp bot commented May 19, 2021

Error running benchmark: xlc-remark

stdoutfatal: couldn't find remote ref xlc-remark

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
A2-insubstantial Pull request requires no code review (e.g., a sub-repository hash update). B0-silent Changes should not be mentioned in any release notes C1-low PR touches the given topic and has a low impact on builders.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants