RPC Parameters to accept input and data field #6094

gfukushima · 2023-10-26T14:58:41Z

PR description

This PR changes the RPC to accept input as well as data.

Fixed Issue(s)

Fixes #6055
Also might get rid of some issues that we had in the Hive RPC suite.

Signed-off-by: Gabriel Fukushima <[email protected]>

github-actions · 2023-10-26T14:58:57Z

I thought about documentation and added the doc-change-required label to this PR if updates are required.
I thought about the changelog and included a changelog update if required.
If my PR includes database changes (e.g. KeyValueSegmentIdentifier) I have thought about compatibility and performed forwards and backwards compatibility tests

Signed-off-by: Gabriel Fukushima <[email protected]>

shemnon

Changing signature is desired, but not required.

shemnon · 2023-10-27T14:27:29Z

...in/java/org/hyperledger/besu/ethereum/api/jsonrpc/internal/parameters/JsonCallParameter.java

@@ -40,6 +40,31 @@ public class JsonCallParameter extends CallParameter {

  private final Optional<Boolean> strict;

+  public JsonCallParameter(


Is this used anywhere outside of tests? Can we just rip the band-aid off and migrate to the new signaure? IntelliJ has a tool for this Refactor>Change Signature... (command/alt F6)

Only used in tests, changing class to only use a single constructor. thanks for the feedback.

Signed-off-by: Gabriel Fukushima <[email protected]>

…ith_input_field

Signed-off-by: Gabriel Fukushima <[email protected]>

…ith_input_field

gfukushima · 2023-10-27T17:50:43Z

Docs will need to update this page https://besu.hyperledger.org/public-networks/reference/api/objects#transaction-call-object

* Accept input or data as payload for RPC calls Signed-off-by: Gabriel Fukushima <[email protected]> * Add json new rpc valid and invalid request to test the changes Signed-off-by: Gabriel Fukushima <[email protected]> * Change JsonCallParameter signature to avoid duplicating constructor Signed-off-by: Gabriel Fukushima <[email protected]> * Add changelog Signed-off-by: Gabriel Fukushima <[email protected]> --------- Signed-off-by: Gabriel Fukushima <[email protected]> (cherry picked from commit 6dd558b)

* Unsigned timestamps and blob gas used (#6046) * lots of places an unsigned timestamp is a problem * adds unchecked annotations to OptionalUnsignedLong rpc parameter type --------- Signed-off-by: Justin Florentine <[email protected]> (cherry picked from commit a90ea05) * [MINOR] ux improvements (#6049) * log command line option that is affected * made plugins summary log part of config overview * check for null plugin context Signed-off-by: Sally MacFarlane <[email protected]> --------- Signed-off-by: Sally MacFarlane <[email protected]> (cherry picked from commit e8bca61) * Update changelog release (#6062) Signed-off-by: Gabriel-Trintinalia <[email protected]> (cherry picked from commit f810887) * Dencun corner cases (#6060) * cherry pick changes from https://github.com/hyperledger/besu/pull/6054/files\#diff-22b78733e37a697fa8d1d8a02d2a87fe5ccea9cf67c34ce5e6311f024c14abd6L643-R738 Signed-off-by: Sally MacFarlane <[email protected]> * cherry pick changes from https://github.com/hyperledger/besu/pull/6054/files\#diff-61db834b59eae5ce5c438462505de1add8fa244deda830742060d15f668a9806R39-R44 Signed-off-by: Sally MacFarlane <[email protected]> * formatting Signed-off-by: Sally MacFarlane <[email protected]> * update the EIP-6110 acceptance tests Signed-off-by: Danno Ferrin <[email protected]> --------- Signed-off-by: Sally MacFarlane <[email protected]> Signed-off-by: Danno Ferrin <[email protected]> Co-authored-by: Danno Ferrin <[email protected]> (cherry picked from commit 9d9fe8c) * add retry logic on sync pipeline for rocksdb issue (#6004) * add retry logic for sync pipeline with rocksdb issue Signed-off-by: Karim TAAM <[email protected]> (cherry picked from commit c839a3b) * Mining options refactor (#6027) Signed-off-by: Fabio Di Fabio <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit 20a82d4) * Update reference tests to Cancun (#6054) * Update reference tests to Cancun Update reference tests to cancun tests. Signed-off-by: Danno Ferrin <[email protected]> * update the subrepo Signed-off-by: Danno Ferrin <[email protected]> * update the EIP-6110 acceptance tests Signed-off-by: Danno Ferrin <[email protected]> * update to develop Signed-off-by: Danno Ferrin <[email protected]> --------- Signed-off-by: Danno Ferrin <[email protected]> Signed-off-by: Sally MacFarlane <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit 909649f) * Optimize GetPooledTransactionsFromPeerTask with HashSet (#6071) Switch from using a List to a HashSet for transaction hashes in GetPooledTransactionsFromPeerTask to improve performance. Signed-off-by: Suyash Nayan <[email protected]> Signed-off-by: Sally MacFarlane <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit a2dbb82) * Decouple TrieLogManager and CachedWorldStorageManager (#6072) Separate out the concepts of world state caching and trie log management. Remove AbstractTrieLogManager and make TrieLogManager the concrete implementation. Signed-off-by: Simon Dudley <[email protected]> (cherry picked from commit 20f518e) * Implement miner_setMinPriorityFee and miner_getMinPriorityFee (#6080) * Refactor mining options Signed-off-by: Fabio Di Fabio <[email protected]> * Fix null pointer exception Signed-off-by: Fabio Di Fabio <[email protected]> * fix another null pointer exception Signed-off-by: Fabio Di Fabio <[email protected]> * uncomment code Signed-off-by: Fabio Di Fabio <[email protected]> * Move miner options tests Signed-off-by: Fabio Di Fabio <[email protected]> * Unit test fixes Signed-off-by: Fabio Di Fabio <[email protected]> * Removed the commented code Signed-off-by: Fabio Di Fabio <[email protected]> * WIP Signed-off-by: Fabio Di Fabio <[email protected]> * WIP Signed-off-by: Fabio Di Fabio <[email protected]> * New miner option: min-priority-fee Signed-off-by: Fabio Di Fabio <[email protected]> * Remove not relevant for this feature Signed-off-by: Fabio Di Fabio <[email protected]> * Remove not relevant for this feature Signed-off-by: Fabio Di Fabio <[email protected]> * Fix javadoc Signed-off-by: Fabio Di Fabio <[email protected]> * Remove code not belonging to this PR Signed-off-by: Fabio Di Fabio <[email protected]> * coinbase is an updatable parameter Signed-off-by: Fabio Di Fabio <[email protected]> * Move MiningOptions to upper package Signed-off-by: Fabio Di Fabio <[email protected]> * Fix coinbase for *bft Signed-off-by: Fabio Di Fabio <[email protected]> * Implement methods to get and set min priority fee Signed-off-by: Gabriel-Trintinalia <[email protected]> * Fix spotless Signed-off-by: Gabriel-Trintinalia <[email protected]> * Apply suggestions from code review Signed-off-by: Fabio Di Fabio <[email protected]> * Update besu/src/main/java/org/hyperledger/besu/cli/BesuCommand.java [skip-ci] Co-authored-by: Sally MacFarlane <[email protected]> Signed-off-by: Fabio Di Fabio <[email protected]> * Add new config option to everything config Signed-off-by: Gabriel-Trintinalia <[email protected]> * Fix unit test Signed-off-by: Gabriel-Trintinalia <[email protected]> * Accept PR suggestions Signed-off-by: Gabriel-Trintinalia <[email protected]> --------- Signed-off-by: Fabio Di Fabio <[email protected]> Signed-off-by: Gabriel-Trintinalia <[email protected]> Signed-off-by: Stefan Pingel <[email protected]> Co-authored-by: Fabio Di Fabio <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> Co-authored-by: Stefan Pingel <[email protected]> (cherry picked from commit 3310c41) * Use Bytes Trie to track warm addresses (#6069) * Use Bytes Trie to track warm addresses Move from a java HashSet to a custom Trie based on bytes to store the warm addresses, creates, and self-destructs. This avoids needing to calculate java hashes or engage in using custom Comparators. Signed-off-by: Danno Ferrin <[email protected]> * codeql scan Signed-off-by: Danno Ferrin <[email protected]> --------- Signed-off-by: Danno Ferrin <[email protected]> Signed-off-by: Sally MacFarlane <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit af011d2) * Migrate Operand Stack to Growing Stack (#6068) To improve the performance of CALL operations move the OperandStack and ReturnStack to growing stacks instead of a fully allocated stack. Signed-off-by: Danno Ferrin <[email protected]> (cherry picked from commit 949c724) * Remove a BonsaiWorldStateProvider constructor (#6090) Was only used for supporting test code and can instead reuse static factory from InMemoryKeyValueStorageProvider Signed-off-by: Simon Dudley <[email protected]> (cherry picked from commit 9a22703) * add RpcEndpointService to thread runner (#6091) Signed-off-by: Sally MacFarlane <[email protected]> (cherry picked from commit 7ac8af0) * ETC 'Spiral' network upgrade (#6078) * Add 23.10.2 section to changelog Signed-off-by: Diego López León <[email protected]> * Set ENR tree for DNS discovery for Mordor network Signed-off-by: Diego López León <[email protected]> * Add ECIP-1109: 'Spiral' network upgrade support Signed-off-by: Diego López León <[email protected]> --------- Signed-off-by: Diego López León <[email protected]> Signed-off-by: Sally MacFarlane <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit f58f6cf) * Trigger contextEnter/Exit for all frames, including root (#6074) * Trigger contextEnter/Exit for all frames, including root * Differentiate between context entry and re-entry in `OperationTracer` * Update evm/src/test/java/org/hyperledger/besu/evm/processor/AbstractMessageProcessorTest.java Co-authored-by: Sally MacFarlane <[email protected]> Signed-off-by: delehef <[email protected]> --------- Signed-off-by: Franklin Delehelle <[email protected]> Signed-off-by: delehef <[email protected]> Signed-off-by: Sally MacFarlane <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit 0345b24) * feat: add a way to read memory without altering the word capacity (#6073) * feat: add a way to read memory without altering the word capacity * add tests Signed-off-by: Daniel Lehrner <[email protected]> Signed-off-by: Franklin Delehelle <[email protected]> * Fix read-past-end * Do not abuse method overload * Update CHANGELOG.md Signed-off-by: delehef <[email protected]> Signed-off-by: Franklin Delehelle <[email protected]> * add tests for MessageFrame.shadowReadMemory Signed-off-by: Daniel Lehrner <[email protected]> Signed-off-by: Franklin Delehelle <[email protected]> * Straddled reads tests Signed-off-by: Franklin Delehelle <[email protected]> --------- Signed-off-by: Franklin Delehelle <[email protected]> Signed-off-by: Daniel Lehrner <[email protected]> Signed-off-by: delehef <[email protected]> Signed-off-by: delehef <[email protected]> Co-authored-by: Daniel Lehrner <[email protected]> (cherry picked from commit edf23cb) * renamed env field (#6096) Signed-off-by: Justin Florentine <[email protected]> (cherry picked from commit 67ef9e0) * [MINOR] Upgrade netty and grpc (#6100) * Upgrade netty and grpc * fix verification file Signed-off-by: Simon Dudley <[email protected]> --------- Signed-off-by: Sally MacFarlane <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit accac1c) * TraceService: return results for transactions in block (#6087) * TraceService: return results for transactions in block Signed-off-by: Daniel Lehrner <[email protected]> (cherry picked from commit a60b31b) * RPC Parameters to accept input and data field (#6094) * Accept input or data as payload for RPC calls Signed-off-by: Gabriel Fukushima <[email protected]> * Add json new rpc valid and invalid request to test the changes Signed-off-by: Gabriel Fukushima <[email protected]> * Change JsonCallParameter signature to avoid duplicating constructor Signed-off-by: Gabriel Fukushima <[email protected]> * Add changelog Signed-off-by: Gabriel Fukushima <[email protected]> --------- Signed-off-by: Gabriel Fukushima <[email protected]> (cherry picked from commit 6dd558b) * Fix some typos (#6093) * Fix some typos * Update plugin version Signed-off-by: GoodDaisy <[email protected]> --------- Signed-off-by: GoodDaisy <[email protected]> (cherry picked from commit e814886) * Correct reference test blobgas calculation (#6107) * Correct reference test blobgas calculation Fix tpyo that resulted in an NPE in t8n blob gas calculations. Signed-off-by: Danno Ferrin <[email protected]> * changelog Signed-off-by: Danno Ferrin <[email protected]> * spotless Signed-off-by: Danno Ferrin <[email protected]> --------- Signed-off-by: Danno Ferrin <[email protected]> (cherry picked from commit d0a6a70) * Restore javadoc and sources jar as trusted artifacts (#6109) Makes Idea happy again as documented here https://docs.gradle.org/6.8.3/userguide/dependency_verification.html#sec:skipping-javadocs Signed-off-by: Fabio Di Fabio <[email protected]> (cherry picked from commit 311570f) * Add API to set and get the minGasPrice at runtime (#6097) Signed-off-by: Fabio Di Fabio <[email protected]> (cherry picked from commit de8ca10) * Don't put NONCE_TOO_LOW transactions into the invalid nonce cache (#6067) * Don't put NONCE_TOO_LOW transactions into the invalid nonce cache Signed-off-by: Matthew Whitehead <[email protected]> * Update unit tests Signed-off-by: Matthew Whitehead <[email protected]> * Use list of errors to ignore Signed-off-by: Matthew Whitehead <[email protected]> --------- Signed-off-by: Matthew Whitehead <[email protected]> Signed-off-by: Matt Whitehead <[email protected]> Signed-off-by: Fabio Di Fabio <[email protected]> Co-authored-by: Fabio Di Fabio <[email protected]> (cherry picked from commit 84dee29) * Journaled world state (#6023) Introduce a new Journaled World State Updater. Within a transaction it keeps one copy of account and storage state, restoring previous revisions on reverts and exceptional halts. This updater only supports post-merge semantics with regard to empty accounts, namely that they do not exist in world state. Adds an EvmConfiguration option for stacked vs journaled updater, and wire it in where needed. The staked updater is default mode, which is the current behavior prior to this patch. Signed-off-by: Danno Ferrin <[email protected]> (cherry picked from commit 094c841) * setMinPriorityFee - Return Invalid Param when invalid and use hexadecimal instead of Long (#6099) Signed-off-by: Gabriel-Trintinalia <[email protected]> (cherry picked from commit 7acdd87) * [MINOR] - Add 23.10.1 correct changelog (#6110) Signed-off-by: Gabriel-Trintinalia <[email protected]> (cherry picked from commit 236779d) * Add transaction selector based on min priority fee parameter (#6083) Signed-off-by: Gabriel-Trintinalia <[email protected]> (cherry picked from commit 41b9575) * Add config option to clique to allow not creating empty blocks (#6082) Signed-off-by: Jason Frame <[email protected]> (cherry picked from commit 6a2d41f) * load all accounts into cache (#6101) There was a slight problem on the bonsai side because all account reads did not go through a single method. One of the two add the account to the cache but the other did not. This had two consequences: Less good performance because certain accounts had to be read several times and also all account reads were not marked in the trielog. This will fix both problems. Signed-off-by: Karim TAAM <[email protected]> (cherry picked from commit d049cb3) * Reference Tests v13 (#6114) v13 of the official Ethereum Reference Tests. Signed-off-by: Danno Ferrin <[email protected]> (cherry picked from commit cea3d8a) * clean up the ProcessableBlockHeader (#6117) * clean up Signed-off-by: [email protected] <[email protected]> (cherry picked from commit 646c5a3) * Log missing chain head as warning, not trace (#6127) Signed-off-by: Matthew Whitehead <[email protected]> (cherry picked from commit 83ae69a) * Update RPCs for yParity (#6119) Update the GraphQL and JSON-RPC endpoints to provide `yParity` instead of `v` for non-legacy transactions. Update the JSON-RPC tests to use the Hive data. Add tests for Shanghai and Cancun Blocks. Signed-off-by: Danno Ferrin <[email protected]> (cherry picked from commit 2284242) * Make tracer in block building block aware (#6135) Signed-off-by: [email protected] <[email protected]> (cherry picked from commit f42f8c1) * Revert "Discard invalid transaction" warning logs (#6137) * Revert "Log missing chain head as warning, not trace (#6127)" * leave chain head at warning, just revert the discard warning Signed-off-by: garyschulte <[email protected]> (cherry picked from commit 914ab79) * Reverse sort order (#6106) * Reverse added order and sequence number Signed-off-by: Matthew Whitehead <[email protected]> * Remove extraneous 'addedAt' check Signed-off-by: Matthew Whitehead <[email protected]> --------- Signed-off-by: Matthew Whitehead <[email protected]> (cherry picked from commit 0203092) * Force tx replacement price bump to zero when zero base fee market is configured (#6079) Signed-off-by: Fabio Di Fabio <[email protected]> (cherry picked from commit 636ad8a) * Time limited block creation (#6044) Signed-off-by: Fabio Di Fabio <[email protected]> Co-authored-by: Sally MacFarlane <[email protected]> (cherry picked from commit 8319fae) * Limit memory used in handling invalid blocks (#6138) Signed-off-by: Jason Frame <[email protected]> (cherry picked from commit 701cbb0) * Delete leftPad when capturing the stack before and after a frame execution (#6102) * Delete leftPad when capturing the stack before and after the execution * Still use leftPad when displaying the stack in the output (ex. for debug_traceTransaction) * Fix integration test * Use StringBuilder to left pad the hex representation of a 32 bytes Signed-off-by: Ameziane H <[email protected]> (cherry picked from commit 9710a9a) * fix yParity flakey test (#6151) Fix the flakeiness in EthGetTransactionByHashTest as well as some other sonar identified cleanup. Signed-off-by: Danno Ferrin <[email protected]> (cherry picked from commit 4b58d07) * Apply the same reverse sort order as https://github.com/hyperledger/b… (#6146) * Apply the same reverse sort order as #6106 but to the base fee sorter Signed-off-by: Matthew Whitehead <[email protected]> * Fix unit tests Signed-off-by: Matthew Whitehead <[email protected]> * Update eviction unit tests to expect highest-sequence TXs be evicted first Signed-off-by: Matthew Whitehead <[email protected]> * Update change log Signed-off-by: Matthew Whitehead <[email protected]> * Spotless fixes Signed-off-by: Matthew Whitehead <[email protected]> --------- Signed-off-by: Matthew Whitehead <[email protected]> (cherry picked from commit 8afad41) --------- Co-authored-by: Sally MacFarlane <[email protected]> Co-authored-by: Gabriel-Trintinalia <[email protected]> Co-authored-by: matkt <[email protected]> Co-authored-by: Fabio Di Fabio <[email protected]> Co-authored-by: Danno Ferrin <[email protected]> Co-authored-by: Suyash Nayan <[email protected]> Co-authored-by: Simon Dudley <[email protected]> Co-authored-by: Diego López León <[email protected]> Co-authored-by: delehef <[email protected]> Co-authored-by: daniellehrner <[email protected]> Co-authored-by: Gabriel Fukushima <[email protected]> Co-authored-by: GoodDaisy <[email protected]> Co-authored-by: Matt Whitehead <[email protected]> Co-authored-by: Jason Frame <[email protected]> Co-authored-by: Stefan Pingel <[email protected]> Co-authored-by: garyschulte <[email protected]> Co-authored-by: ahamlat <[email protected]>

* Accept input or data as payload for RPC calls Signed-off-by: Gabriel Fukushima <[email protected]> * Add json new rpc valid and invalid request to test the changes Signed-off-by: Gabriel Fukushima <[email protected]> * Change JsonCallParameter signature to avoid duplicating constructor Signed-off-by: Gabriel Fukushima <[email protected]> * Add changelog Signed-off-by: Gabriel Fukushima <[email protected]> --------- Signed-off-by: Gabriel Fukushima <[email protected]>

gfukushima added 3 commits October 26, 2023 11:49

Accept input or data as payload for RPC calls

9014fa4

Signed-off-by: Gabriel Fukushima <[email protected]>

Add json new rpc valid and invalid request to test the changes

34bb2f4

Signed-off-by: Gabriel Fukushima <[email protected]>

Merge branch 'main' into rpc_with_input_field

1c9fae3

gfukushima marked this pull request as ready for review October 26, 2023 14:58

gfukushima marked this pull request as draft October 26, 2023 14:58

gfukushima marked this pull request as ready for review October 27, 2023 12:50

gfukushima requested a review from matkt October 27, 2023 12:50

Merge branch 'main' into rpc_with_input_field

bb2b8a4

Signed-off-by: Gabriel Fukushima <[email protected]>

shemnon approved these changes Oct 27, 2023

View reviewed changes

gfukushima added 5 commits October 27, 2023 14:22

Change JsonCallParameter signature to avoid duplicating constructor

8d5fd5d

Signed-off-by: Gabriel Fukushima <[email protected]>

Merge remote-tracking branch 'origin/rpc_with_input_field' into rpc_w…

62d5846

…ith_input_field

Merge branch 'main' into rpc_with_input_field

20c5eaa

Signed-off-by: Gabriel Fukushima <[email protected]>

Add changelog

24e4cf9

Signed-off-by: Gabriel Fukushima <[email protected]>

Merge remote-tracking branch 'origin/rpc_with_input_field' into rpc_w…

0af765d

…ith_input_field

gfukushima added the doc-change-required Indicates an issue or PR that requires doc to be updated label Oct 27, 2023

gfukushima merged commit 6dd558b into hyperledger:main Oct 27, 2023
19 checks passed

siladu mentioned this pull request Oct 28, 2023

prysm-besu on Holesky: prysm returns error=processPastLogs: Execution reverted #6041

Closed

mjsmike62 mentioned this pull request Nov 6, 2023

Document that input and data fields are acceptable for the payload of transaction-related RPC methods #6133

Closed

alexandratran removed the doc-change-required Indicates an issue or PR that requires doc to be updated label Nov 6, 2023

mjsmike62 mentioned this pull request Nov 7, 2023

Document that input and data fields are acceptable for the payload of transaction-related RPC methods hyperledger/besu-docs#1437

Closed

jflo mentioned this pull request Nov 10, 2023

Release 23.10.x #6155

Merged

jflo mentioned this pull request Nov 10, 2023

Release 23.10.x #6158

Closed

This was referenced Mar 7, 2024

RPC call parameters do not accept input and data field simultaneously #6697

Closed

Transaction call object to accept both input and data field if equal #6702

Merged

shemnon mentioned this pull request Jul 23, 2024

eth_call Returned "Execution reverted" Error, Since "input" Is Not Supported as a Parameter in quorum-test-network #7290

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RPC Parameters to accept input and data field #6094

RPC Parameters to accept input and data field #6094

gfukushima commented Oct 26, 2023 •

edited

Loading

github-actions bot commented Oct 26, 2023 •

edited by gfukushima

Loading

shemnon left a comment

shemnon Oct 27, 2023

gfukushima Oct 27, 2023 •

edited

Loading

gfukushima commented Oct 27, 2023

		@@ -40,6 +40,31 @@ public class JsonCallParameter extends CallParameter {

		private final Optional<Boolean> strict;

		public JsonCallParameter(

RPC Parameters to accept input and data field #6094

RPC Parameters to accept input and data field #6094

Conversation

gfukushima commented Oct 26, 2023 • edited Loading

PR description

Fixed Issue(s)

github-actions bot commented Oct 26, 2023 • edited by gfukushima Loading

shemnon left a comment

Choose a reason for hiding this comment

shemnon Oct 27, 2023

Choose a reason for hiding this comment

gfukushima Oct 27, 2023 • edited Loading

Choose a reason for hiding this comment

gfukushima commented Oct 27, 2023

gfukushima commented Oct 26, 2023 •

edited

Loading

github-actions bot commented Oct 26, 2023 •

edited by gfukushima

Loading

gfukushima Oct 27, 2023 •

edited

Loading