Skip to content
This repository has been archived by the owner on Sep 13, 2022. It is now read-only.

refactor(storage): optimize performance #296

Merged
merged 22 commits into from
May 29, 2020
Merged

refactor(storage): optimize performance #296

merged 22 commits into from
May 29, 2020

Conversation

zeroqn
Copy link
Contributor

@zeroqn zeroqn commented May 28, 2020

What type of PR is this?
refactor

What this PR does / why we need it:
optimize performance

Which issue(s) this PR fixes:

Fixes #

Special notes for your reviewer:

zeroqn added 16 commits May 28, 2020 19:56
@zeroqn
refactor(storage): insert_transactions() now takes block height
1e174ca
@zeroqn
chore(storage): disable apm for better compilation errors
93e6472
@zeroqn
refactor(stroage): force index in insert_transactions fn signature
1e8315c
@zeroqn
refactor(storage): storage api
f2a4581 
Add iter to adapter trait
Remove index from key prefix
@zeroqn
chore(storage): bump rocksdb to 0.14
eebeffb
@zeroqn
change(storage): use sync codec instead
b5bd05a
@zeroqn
feat(storage): add iter suppoert to rocksdb api
beb7aab
@zeroqn
feat(storage): implement iter api for both memory and rocksdb adapter
5544566
@zeroqn
fix(storage): test code
467ebcc
@zeroqn
feat(storage): bench example
1bb22be
@zeroqn
change(storage): lower NUMBER_OF_TXS_PER_ROUND to 1.5W
9561dfa
@zeroqn
feat(storage): query transaction and receipt by hash
ec1d572
@zeroqn
change(storage): speed up get_transactions
a118e6f
@zeroqn
refactor: use new storage api
4c213a9
@zeroqn
chore: restore apm
8fda2d0
@zeroqn
fix: test code
2f7f764
@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Accept request.

@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Docker builded. "mutadev/muta:2f7f764"
Run chaos test on k8s named "muta-pr296"

@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Date(muta-pr296) 1 2 3 4
2020-05-28T12:06:04.904Z 0 0 0 0
2020-05-28T12:10:04.940Z 129 129 129 129
2020-05-28T12:14:11.148Z 261 261 261 261
2020-05-28T12:18:11.188Z 397 397 397 397
2020-05-28T12:22:11.232Z 521 521 521 521
2020-05-28T12:26:11.284Z 667 667 667 667
2020-05-28T12:30:11.316Z 814 814 814 814
2020-05-28T12:34:11.356Z 951 951 951 951
2020-05-28T12:38:11.388Z 1084 1084 1084 1084
2020-05-28T12:42:12.416Z 1187 1187 1187 1187
2020-05-28T12:46:12.476Z 1311 1300 1311 1311
2020-05-28T12:50:12.588Z 1442 1442 1442 1442
2020-05-28T12:54:12.676Z 1561 1561 1561 1561
2020-05-28T12:58:12.736Z 1690 1690 1690 1690
2020-05-28T13:02:12.768Z 1799 1799 1799 1799
2020-05-28T13:06:12.824Z 1936 1936 1936 1936
2020-05-28T13:10:15.912Z 2068 2068 2068 2068
2020-05-28T13:14:15.988Z 2208 2208 2208 2208
2020-05-28T13:18:17.073Z 2340 2340 2340 2340
2020-05-28T13:22:17.108Z 2475 2475 2475 2475
2020-05-28T13:26:17.160Z 2600 2600 2600 2600
2020-05-28T13:30:17.192Z 2736 2736 2736 2736
2020-05-28T13:34:17.460Z 2886 2886 2886 2886
2020-05-28T13:38:17.496Z 2988 2988 2988 2988
tx_block sec_block tx_sec avg_round
1279.00 2.00 723.00 0

@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Accept request.

@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Docker builded. "mutadev/muta:78dddce"
Run chaos test on k8s named "muta-pr296"

@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Accept request.

@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Docker builded. "mutadev/muta:96100e4"
Run chaos test on k8s named "muta-pr296"

@muta-bot
Copy link

muta-bot bot commented May 28, 2020

Date(muta-pr296) 1 2 3 4
2020-05-28T15:12:52.176Z 4 4 4 4
2020-05-28T15:16:52.220Z 123 123 123 123
2020-05-28T15:20:52.264Z 251 251 251 251
2020-05-28T15:24:52.356Z 387 387 387 387
2020-05-28T15:28:54.632Z 507 507 507 507
2020-05-28T15:32:54.664Z 641 641 641 641
2020-05-28T15:36:54.936Z 740 740 740 740
2020-05-28T15:40:54.992Z 872 872 872 872
2020-05-28T15:44:55.088Z 994 994 994 996
2020-05-28T15:48:56.176Z 1131 1131 1131 1131
2020-05-28T15:52:56.208Z 1243 1243 1243 1243
2020-05-28T15:56:56.252Z 1347 1347 1347 1347
2020-05-28T16:00:56.312Z 1482 1482 1483 1483
2020-05-28T16:05:01.232Z 1605 1605 1605 1605
2020-05-28T16:09:01.276Z 1737 1737 1737 1737
2020-05-28T16:13:01.308Z 1843 1843 1843 1843
2020-05-28T16:17:01.360Z 1978 1978 1978 1978
2020-05-28T16:21:01.412Z
2020-05-28T16:25:01.440Z
2020-05-28T16:29:01.448Z
2020-05-28T16:33:01.460Z
2020-05-28T16:37:01.468Z
2020-05-28T16:41:01.489Z
2020-05-28T16:45:01.500Z
tx_block sec_block tx_sec avg_round
undefined undefined undefined undefined

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Accept request.

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Docker builded. "mutadev/muta:784a731"
Run chaos test on k8s named "muta-pr296"

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Date(muta-pr296) 1 2 3 4
2020-05-29T02:33:55.240Z 0 0 0 0
2020-05-29T02:37:55.284Z 152 152 152 152
2020-05-29T02:41:55.316Z 299 299 299 299
2020-05-29T02:45:55.352Z 432 432 432 432
2020-05-29T02:49:55.384Z 567 567 567 567
2020-05-29T02:53:55.416Z 706 706 706 706
2020-05-29T02:57:55.448Z 830 830 830 830
2020-05-29T03:01:55.484Z 940 940 940 940
2020-05-29T03:05:55.540Z 1056 1056 1056 1054
2020-05-29T03:09:55.696Z 1190 1190 1190 1190
2020-05-29T03:13:55.740Z 1324 1324 1324 1324
2020-05-29T03:17:55.784Z 1399 1377 1399 1399
2020-05-29T03:21:55.820Z 1441 1431 1441 1441
2020-05-29T03:25:55.868Z 1491 1431 1491 1491
2020-05-29T03:29:56.916Z 1552 1432 1553 1553
2020-05-29T03:33:56.996Z 1607 1487 1607 1607
2020-05-29T03:38:03.400Z 1655 1487 1655 1655
2020-05-29T03:42:03.448Z 1711 1433 1711 1711
2020-05-29T03:46:03.492Z 1769 1487 1769 1769
2020-05-29T03:50:03.524Z 1825 1487 1825 1825
2020-05-29T03:54:03.564Z 1877 1433 1877 1877
2020-05-29T03:58:03.668Z 1923 1487 1923 1923
2020-05-29T04:02:03.712Z 1975 1433 1975 1975
2020-05-29T04:06:08.832Z 2025 1487 2025 2025
tx_block sec_block tx_sec avg_round
1059.00 10.00 106.00 0.25

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Accept request.

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Docker builded. "mutadev/muta:aa3eed6"
Run chaos test on k8s named "muta-pr296"

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Accept request.

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Accept request.

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Docker builded. "mutadev/muta:fbebb19"
Run chaos test on k8s named "muta-pr296"

@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Docker builded. "mutadev/muta:08deb1b"
Run chaos test on k8s named "muta-pr296"

@yejiayu yejiayu merged commit 49cb7b6 into nervosnetwork:master May 29, 2020
@muta-bot
Copy link

muta-bot bot commented May 29, 2020

Date(muta-pr296) 1 2 3 4
2020-05-29T06:31:12.488Z 18 18 18 18
2020-05-29T06:35:12.524Z 154 154 154 154
2020-05-29T06:39:12.572Z 275 275 275 275
2020-05-29T06:43:12.612Z 405 405 405 405
2020-05-29T06:47:12.648Z
2020-05-29T06:51:12.656Z
2020-05-29T06:55:12.664Z
2020-05-29T06:59:12.676Z
2020-05-29T07:03:12.684Z
2020-05-29T07:07:12.696Z
2020-05-29T07:11:12.704Z
2020-05-29T07:15:12.712Z
2020-05-29T07:19:12.720Z
2020-05-29T07:23:12.736Z
2020-05-29T07:27:12.744Z
2020-05-29T07:31:12.752Z
2020-05-29T07:35:12.776Z
2020-05-29T07:39:12.792Z
2020-05-29T07:43:12.816Z
2020-05-29T07:47:12.832Z
2020-05-29T07:51:12.860Z
2020-05-29T07:55:12.868Z
2020-05-29T07:59:12.948Z
2020-05-29T08:03:12.968Z
tx_block sec_block tx_sec avg_round
undefined undefined undefined undefined

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@zeroqn @yejiayu