Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

randomness #10: randomness API update from randomnet #12335

Merged
merged 4 commits into from
Mar 2, 2024

Conversation

zjma
Copy link
Contributor

@zjma zjma commented Mar 1, 2024

  • [move] fixes to randomness.move

  • Fixed the Prover spec

Fixed the spec to unblock the PR.

Need to prove the introduced assumptions with proper loop invariants, which should be provable.

  • lint

Description

Test Plan

Copy link

trunk-io bot commented Mar 1, 2024

⏱️ 35h 45m total CI duration on this PR
Job Cumulative Duration Recent Runs
rust-unit-coverage 12h 🟥
rust-smoke-coverage 3h 56m 🟩
forge-framework-upgrade-test / forge 3h 4m 🟩🟩
execution-performance / single-node-performance 2h 30m 🟩🟥🟩🟩🟩 (+2 more)
rust-unit-tests 2h 23m 🟥🟩🟩🟩 (+1 more)
rust-smoke-tests 2h 18m 🟩🟥🟩🟩
windows-build 1h 46m 🟩🟩🟩🟩🟩 (+2 more)
rust-move-tests 1h 14m 🟥🟩🟩🟩
rust-move-unit-coverage 1h 8m 🟩🟩🟩🟩
rust-images / rust-all 1h 8m 🟩🟩🟩🟩 (+1 more)
forge-e2e-test / forge 56m 🟩🟩🟩🟩
forge-compat-test / forge 54m 🟩🟩🟩🟩
rust-lints 35m 🟩🟩🟩🟥🟩 (+1 more)
cli-e2e-tests / run-cli-tests 24m 🟩🟩🟩🟩
run-tests-main-branch 23m 🟩🟩🟩🟩🟩 (+2 more)
check 21m 🟩🟩🟩🟩🟩 (+1 more)
check-dynamic-deps 12m 🟩🟩🟩🟩🟩 (+2 more)
general-lints 11m 🟩🟩🟩🟩🟩 (+1 more)
indexer-grpc-e2e-tests / test-indexer-grpc-docker-compose 9m 🟩🟩🟩🟩
node-api-compatibility-tests / node-api-compatibility-tests 3m 🟩🟩🟩🟩
semgrep/ci 3m 🟩🟩🟩🟩🟩 (+2 more)
file_change_determinator 1m 🟩🟩🟩🟩🟩 (+2 more)
file_change_determinator 1m 🟩🟩🟩🟩🟩 (+1 more)
execution-performance / file_change_determinator 1m 🟩🟩🟩🟩🟩 (+1 more)
file_change_determinator 1m 🟩🟩🟩🟩🟩 (+1 more)
permission-check 36s 🟩🟩🟩🟩🟩 (+2 more)
permission-check 25s 🟩🟩🟩🟩🟩 (+2 more)
permission-check 22s 🟩🟩🟩🟩🟩 (+2 more)
permission-check 18s 🟩🟩🟩🟩🟩 (+2 more)
permission-check 17s 🟩🟩🟩🟩🟩 (+1 more)
determine-docker-build-metadata 10s 🟩🟩🟩🟩🟩 (+1 more)

settingsfeedbackdocs ⋅ learn more about trunk.io

@zjma zjma requested review from alinush and danielxiangzl March 1, 2024 23:43
@zjma zjma marked this pull request as ready for review March 1, 2024 23:44
@zjma zjma requested review from alinush and zekun000 and removed request for davidiw, junkil-park, wrwg and movekevin March 1, 2024 23:44
@zjma zjma added CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR CICD:run-framework-upgrade-test labels Mar 1, 2024
Copy link

codecov bot commented Mar 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 64.0%. Comparing base (eab81de) to head (e86181e).
Report is 4 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main   #12335   +/-   ##
=======================================
  Coverage    64.0%    64.0%           
=======================================
  Files         796      796           
  Lines      176719   176708   -11     
=======================================
+ Hits       113262   113265    +3     
+ Misses      63457    63443   -14     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@zjma zjma enabled auto-merge (squash) March 2, 2024 00:48

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

alinush and others added 4 commits March 1, 2024 18:45
* [move] fixes to randomness.move

* Fixed the Prover spec

Fixed the spec to unblock the PR.

Need to prove the introduced assumptions with proper loop invariants, which should be provable.

* lint

---------

Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>
@zjma zjma force-pushed the zjma/randomness_event_from_randomnet branch from dfae88f to e86181e Compare March 2, 2024 02:51

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

github-actions bot commented Mar 2, 2024

✅ Forge suite compat success on aptos-node-v1.9.5 ==> e86181e2d173ac2dc9661dcede58eaa0413d45e0

Compatibility test results for aptos-node-v1.9.5 ==> e86181e2d173ac2dc9661dcede58eaa0413d45e0 (PR)
1. Check liveness of validators at old version: aptos-node-v1.9.5
compatibility::simple-validator-upgrade::liveness-check : committed: 6588 txn/s, latency: 4998 ms, (p50: 4800 ms, p90: 8900 ms, p99: 9900 ms), latency samples: 237180
2. Upgrading first Validator to new version: e86181e2d173ac2dc9661dcede58eaa0413d45e0
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1088 txn/s, latency: 26435 ms, (p50: 28600 ms, p90: 37400 ms, p99: 38900 ms), latency samples: 57680
3. Upgrading rest of first batch to new version: e86181e2d173ac2dc9661dcede58eaa0413d45e0
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 129 txn/s, submitted: 500 txn/s, expired: 370 txn/s, latency: 48456 ms, (p50: 44400 ms, p90: 71400 ms, p99: 72800 ms), latency samples: 10347
4. upgrading second batch to new version: e86181e2d173ac2dc9661dcede58eaa0413d45e0
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 2165 txn/s, latency: 13832 ms, (p50: 14700 ms, p90: 18900 ms, p99: 19200 ms), latency samples: 106100
5. check swarm health
Compatibility test for aptos-node-v1.9.5 ==> e86181e2d173ac2dc9661dcede58eaa0413d45e0 passed
Test Ok

Copy link
Contributor

github-actions bot commented Mar 2, 2024

✅ Forge suite realistic_env_max_load success on e86181e2d173ac2dc9661dcede58eaa0413d45e0

two traffics test: inner traffic : committed: 7218 txn/s, latency: 5433 ms, (p50: 5100 ms, p90: 6600 ms, p99: 12300 ms), latency samples: 3118600
two traffics test : committed: 100 txn/s, latency: 1919 ms, (p50: 1800 ms, p90: 2200 ms, p99: 6100 ms), latency samples: 1740
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.248, avg: 0.205", "QsPosToProposal: max: 0.394, avg: 0.304", "ConsensusProposalToOrdered: max: 0.473, avg: 0.438", "ConsensusOrderedToCommit: max: 0.301, avg: 0.287", "ConsensusProposalToCommit: max: 0.753, avg: 0.725"]
Max round gap was 2 [limit 4] at version 1469373. Max no progress secs was 7.479467 [limit 15] at version 1469373.
Test Ok

@zjma zjma merged commit 2508826 into main Mar 2, 2024
46 checks passed
@zjma zjma deleted the zjma/randomness_event_from_randomnet branch March 2, 2024 03:22
zjma added a commit that referenced this pull request Mar 2, 2024
* [move] fixes to `randomness.move` (#12250)

* [move] fixes to randomness.move

* Fixed the Prover spec

Fixed the spec to unblock the PR.

Need to prove the introduced assumptions with proper loop invariants, which should be provable.

* lint

---------

Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>

* fix specs

---------

Co-authored-by: Alin Tomescu <[email protected]>
Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>
Copy link
Contributor

github-actions bot commented Mar 2, 2024

✅ Forge suite framework_upgrade success on aptos-node-v1.9.5 ==> e86181e2d173ac2dc9661dcede58eaa0413d45e0

Compatibility test results for aptos-node-v1.9.5 ==> e86181e2d173ac2dc9661dcede58eaa0413d45e0 (PR)
Upgrade the nodes to version: e86181e2d173ac2dc9661dcede58eaa0413d45e0
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 6296 txn/s, latency: 4936 ms, (p50: 4800 ms, p90: 5400 ms, p99: 9900 ms), latency samples: 251860
5. check swarm health
Compatibility test for aptos-node-v1.9.5 ==> e86181e2d173ac2dc9661dcede58eaa0413d45e0 passed
Test Ok

zjma added a commit that referenced this pull request Mar 2, 2024
* [move] fixes to `randomness.move` (#12250)

* [move] fixes to randomness.move

* Fixed the Prover spec

Fixed the spec to unblock the PR.

Need to prove the introduced assumptions with proper loop invariants, which should be provable.

* lint

---------

Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>

* fix specs

---------

Co-authored-by: Alin Tomescu <[email protected]>
Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>
zjma added a commit that referenced this pull request Mar 3, 2024
* randomness type update 3 (#12202)

* randomness #4: RandManager update from randomnet (#12224)

* RandManager update from randomnet

* lint

* lint

* randomness #5: consensus update from randomnet (#12225)

* consensus update from randomnet

* update

* randomness #6: dkg manager update from randomnet (#12226)

* consensus update from randomnet

* update

* update execution client api

* dkg manager update from randomnet

* avoid panic

* make api, indexer, fake aptos db aware of block metadata ext txns (#12227)

* randomness #8: framework update from randomnet (#12228)

* framework update from randomnet

Squashed commit of the following to fix jwk smoke tests:

commit 3bd0154
Author: zhoujun.ma <[email protected]>
Date:   Tue Feb 27 02:47:57 2024 -0800

    update

commit 2eb6add
Author: zhoujun.ma <[email protected]>
Date:   Tue Feb 27 02:12:27 2024 -0800

    update

commit 9d82151
Author: zhoujun.ma <[email protected]>
Date:   Tue Feb 27 01:51:08 2024 -0800

    debug

fix doc test

fix spec

fix doc

update initialization in genesis

update features.move

initialize randomness in genesis

update golden files

private entry fun check and vm updates

* postpone release builder changes

* update goldenfiles

* fix is_safe_call spec

* randomness #9: smoke tests from randomnet (#12282)

* smoke test deps and 1st case from randomnet

* update

* more smoke tests

* randomness #10: randomness API update from randomnet (#12335)

* [move] fixes to `randomness.move` (#12250)

* [move] fixes to randomness.move

* Fixed the Prover spec

Fixed the spec to unblock the PR.

Need to prove the introduced assumptions with proper loop invariants, which should be provable.

* lint

---------

Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>

* fix specs

---------

Co-authored-by: Alin Tomescu <[email protected]>
Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>

* lint

* update genesis

* on-chain resources to indicate dkg/randomness failure injection (#12345)

* dkg/randomness failure injection

* update

* smoke test

* update

* update

* fix scripts

---------

Co-authored-by: Alin Tomescu <[email protected]>
Co-authored-by: Junkil Park <[email protected]>
Co-authored-by: danielxiangzl <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR CICD:run-framework-upgrade-test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants