Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update perf baseline for gas charging coverage improvements #12124

Merged
merged 1 commit into from
Feb 21, 2024

Conversation

igor-aptos
Copy link
Contributor

This increases throughput on a few workloads, decreases throughput on most others

Description

Test Plan

Copy link

trunk-io bot commented Feb 21, 2024

@igor-aptos igor-aptos enabled auto-merge (squash) February 21, 2024 06:55

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

✅ Forge suite compat success on aptos-node-v1.9.5 ==> dbe48ef381f4bc7055988b886f6559c6128c2cee

Compatibility test results for aptos-node-v1.9.5 ==> dbe48ef381f4bc7055988b886f6559c6128c2cee (PR)
1. Check liveness of validators at old version: aptos-node-v1.9.5
compatibility::simple-validator-upgrade::liveness-check : committed: 6495 txn/s, latency: 5104 ms, (p50: 4800 ms, p90: 9300 ms, p99: 10500 ms), latency samples: 227340
2. Upgrading first Validator to new version: dbe48ef381f4bc7055988b886f6559c6128c2cee
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 751 txn/s, latency: 36163 ms, (p50: 41300 ms, p90: 56400 ms, p99: 58500 ms), latency samples: 56380
3. Upgrading rest of first batch to new version: dbe48ef381f4bc7055988b886f6559c6128c2cee
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 363 txn/s, submitted: 556 txn/s, expired: 192 txn/s, latency: 37054 ms, (p50: 36500 ms, p90: 55200 ms, p99: 67000 ms), latency samples: 31287
4. upgrading second batch to new version: dbe48ef381f4bc7055988b886f6559c6128c2cee
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 2195 txn/s, latency: 13566 ms, (p50: 13300 ms, p90: 19300 ms, p99: 19600 ms), latency samples: 103180
5. check swarm health
Compatibility test for aptos-node-v1.9.5 ==> dbe48ef381f4bc7055988b886f6559c6128c2cee passed
Test Ok

Copy link
Contributor

✅ Forge suite realistic_env_max_load success on dbe48ef381f4bc7055988b886f6559c6128c2cee

two traffics test: inner traffic : committed: 7602 txn/s, latency: 5157 ms, (p50: 4800 ms, p90: 6300 ms, p99: 12600 ms), latency samples: 3284120
two traffics test : committed: 100 txn/s, latency: 2188 ms, (p50: 2100 ms, p90: 2400 ms, p99: 9800 ms), latency samples: 1840
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.249, avg: 0.209", "QsPosToProposal: max: 0.445, avg: 0.393", "ConsensusProposalToOrdered: max: 0.574, avg: 0.525", "ConsensusOrderedToCommit: max: 0.480, avg: 0.457", "ConsensusProposalToCommit: max: 1.008, avg: 0.982"]
Max round gap was 1 [limit 4] at version 1535083. Max no progress secs was 7.33084 [limit 15] at version 1535083.
Test Ok

@igor-aptos igor-aptos merged commit bc50dae into main Feb 21, 2024
79 of 80 checks passed
@igor-aptos igor-aptos deleted the igor/update_perf_baseline_for_gas_improvements branch February 21, 2024 17:02
zjma added a commit that referenced this pull request Feb 22, 2024
* Fix `iss`-related bug in Groth16 path & refactor (#12017)

Co-authored-by: Oliver <[email protected]>

* [aptosvm] Simplify VM flows (#11888)

* Duplicated logic for creating the gas meter for view functions has been removed.
* Duplicated logic for calculating gas used for view functions has been removed.
* There was unreachable code in failure transaction cleanup, where the discarded
status has been returned immediately, but then re-checked again. The first check
is shifted inside.
* No more default transaction metadata.
* Scripts are now validated consistently.
* Simplifies transaction execution function signature to avoid `Option<String>`.
* Removes duplicated features from `AptosVM` and keeps them in `MoveVMExt`.
* Fixes a bug when script hash was not computed for `RunOnAbort`.

Related tests are moved  to `move-e2e-tests`.

* [Compiler V2] Critical edge elimination (#11894)

Implement a pass to eliminate critical edges by splitting them with empty blocks

* [consensus configs] reduce sending block size from 2500 to 1900 (#12091)

### Description

The block output limit is no longer hit with p2p txns.

### Test Plan

Forge `realistic_env_max_load` TPS improves.

* [Indexer-grpc] Add profiling support. (#12034)

* Minor aggregator cleanup (#12013)

* Minor aggregator cleanup

* Addressing PR comments

* [move] rotate_authentication_key_call should not modify OriginatingAddress (#12108)

Co-authored-by: Alin Tomescu <[email protected]>

* [Data Streaming Service] Add dynamic prefetching support

* [Data Streaming Service] Add dynamic prefetching unit tests.

* [Data Streaming Service] Update existing integration tests.

* [State Sync] Add backpressure to fast sync receiver.

* Update perf baseline for gas charging coverage improvements (reducing throughput) (#12124)

* Reduce latency of cloning network sender using Arc pointers (#12103)

* Avoid cloning network sender using Arc pointers

* Removing a clone

* 100 node sweep test

* Removing a few clone operations

* reset forge test

* Removing some clones

* Removing clones

* adopt AIP-61 terminology for consistency (#12123)

adopt AIP-61 terminology for consistency

* [Consensus] Remove non-decoupled execution and refactor for cleaner interfaces (#12104)

* fix jwk key logging (#12090)

* remove spurious error lines (#12137)

* randomness #1: types update from randomnet (#12106)

* types update from randomnet

* update

* lint

* lint

* All validators broadcast commit vote messages (#12059)

* All validators broadcast commit messages

* Forge testing

* Increase timeout for forge

* test forge realistic_env_workload_sweep_test

* run realistic_env_workload_sweep_test

* run realistic_env_workload_sweep_test

* run sweep test

* increase forge runner duration

* forge testing

* Letting the proposer also broadcast commit decision for backward compatibility

* removing forge changes

* Added a TODO

* [vm] Resource access control: runtime engine (#10544)

* [vm] Resource access control: runtime engine

Implements the runtime engine for resource access control:

- a representation of access control specifiers in `loaded_data::runtime_access_specifiers`.
- a loader for access specifiers in `runtime::loader::access_specifier_loader`.
- a new stateful object representing the access control logic in `runtime::access_control`.
- finally the use of the `AccessControlState` in `runtime::interpreter`.

* Addressing reviewer comments.

* Addressing reviewer comments.

* typo: PTLA -> PTAL

* Rebasing: adjusting to upstream changes

* Rebasing

* ObjectCodeDeployment API cleanup update (#12133)

* ObjectCodeDeployment API cleanup update (#12141)

* [Compiler-v2] porting more V1 unit tests to V2 (#12085)

* update tests

* fix bug

* fix-12116

* fix missing space

* add expected got

* remove live-var tests

* fix had_erros

* fix

* Enable the max object nesting check (#12129)

* Resolved the warning for unused variable (#12157)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Squashed commit of the following:

commit a50ffec
Author: Zhoujun Ma <[email protected]>
Date:   Thu Feb 22 21:10:12 2024 +0000

    lint

commit 388350f
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 13:04:28 2024 -0800

    update

commit 76f7eca
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:56:04 2024 -0800

    update

commit a663542
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:54:18 2024 -0800

    update

commit b439449
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:34:14 2024 -0800

    update

commit 3378ceb
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:17:06 2024 -0800

    update

commit 6cd6685
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:15:05 2024 -0800

    update

commit 6d89f37
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:13:51 2024 -0800

    update

commit 980f257
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:12:04 2024 -0800

    update

commit 16e9349
Author: Zhoujun Ma <[email protected]>
Date:   Thu Feb 22 18:25:08 2024 +0000

    lint

---------

Co-authored-by: Alin Tomescu <[email protected]>
Co-authored-by: Oliver <[email protected]>
Co-authored-by: George Mitenkov <[email protected]>
Co-authored-by: Zekun Wang <[email protected]>
Co-authored-by: Brian (Sunghoon) Cho <[email protected]>
Co-authored-by: Guoteng Rao <[email protected]>
Co-authored-by: Satya Vusirikala <[email protected]>
Co-authored-by: David Wolinsky <[email protected]>
Co-authored-by: Josh Lind <[email protected]>
Co-authored-by: igor-aptos <[email protected]>
Co-authored-by: Sital Kedia <[email protected]>
Co-authored-by: Wolfgang Grieskamp <[email protected]>
Co-authored-by: Teng Zhang <[email protected]>
Co-authored-by: Junkil Park <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants