[EPIC] Production Stable Gateway

[devbugging]

This epic contains all the work that is needed to make EVM Gateway production stable code, with good tests, benchmarking and general reliability, as well as security hardening.

The remaining work is divided into multiple sub-lists.

1. Data Streaming sub-list covers all the tasks that are needed for the streaming of events and blocks to the clients over websockets.
2. API Completeness ensures we support all the APIs needed to comply with the JSON RPC API specification.
3. Security and testing makes sure we have implemented metrics, do sufficient benchmarking, implement validation and security checks as well as allow secure running of the gateway in production

Data Streaming

Preview Give feedback

1. Implement filter management #7
   +0
   
2. Implement websocket stream client managment #127
   +0
   
3. Integrate events filtering with streaming #142
   +0
   
4. Support polling new data since filter changes #141
   +0
   
5. Discovery on geth implementation #140
   +0
   
6. Subscribing to new events using websockets #139
   +0
   
7. Stream new blocks #163
   +0
   
8. Stream new logs #164
   +0
   
9. Stream new transactions #172
   +0
   

API Completeness

Preview Give feedback

1. Access list API #144
   EVM Feature +2
   
2. Fix errors from missing endpoints reported on Grafana #209
   Bug +1
   
3. Update eth_estimateGas to correctly handle execution reverts #302
   EVM Feature Improvement +3
   
4. Update eth_call to correctly handle execution reverts #296
   EVM Feature Improvement +3
   
5. Fee history API #143
   +0
   
6. Ensure that all fields from the JSON-RPC API specification are present #200
   EVM Feedback Improvement +3
   
7. Missing Block Fields #145
   Bug +1
   
8. Use evm height mapping in APIs #111
   Feature Feedback +2
   
9. Index timestamp of the block #212
   Feedback +1
   
10. Implement the eth_getFilterLogs endpoint #214
    Feature Feedback +2
    
11. Update eth_call & eth_estimateGas with dedicated function from EVM #187
    Feature Feedback +2
    
12. Return proper value for logsBloom field on block endpoints #208
    Bug EVM +2
    
13. Implement sync status #80
    Feature Feedback +2
    
14. Return root field (even if empty) in eth_getTransactionReceipt endpoint #199
    Bug EVM +2
    
15. Implement the eth_mining JSON-RPC API endpoint #188
    Feature Feedback +2
    
16. Check all the receipt data #87
    Feedback +1
    
17. Set a gas price of 0 for the self-rolled transaction used on gas estimation #161
    Bug EVM Improvement +3
    
18. Handle run results #83
    Bug Feedback +2
    
19. Return proper response for eth_getTransactionReceipt #160
    Bug EVM +2
    
20. Check gas price in eth_sendRawTransaction #159
    Feature Feedback +2
    
21. Support returning full transactions #112
    EVM Feature +2
    
22. Index direct calls #115
    Feature Feedback +2
    
23. Support empty "to" address in call #113
    Feature Feedback +2
    
24. Implement getting account code #109
    Feature Feedback +2
    

Security and Stability

Preview Give feedback

1. Implementing metrics #125
   10 of 12
   +0
   
2. Benchmarking #19
   +0
   
3. Docs #169
   Feature Feedback +2
   
4. Batch transaction on pebble db in ingestion engine #278
   Improvement +1
   
5. Validation of transactions submitted #117
   EVM Feature +2
   
6. Support for TLS #193
   Feature Feedback +2
7. Securing Flow account keys #250
   Feature Feedback +2
   
8. Add sane configuration values for batch calls #211
   Feature Feedback +2
   
9. Improve Docker and scripts #101
   Feedback +1
   
10. Improve crash reporting #236
    Feature Feedback +2
    
11. Safe-guard against data races #204
    Improvement +1
    
12. Web3 client acceptance testing #82
    Feature Feedback +2
    
13. Batch database operations #116
    Feature Feedback +2
    
14. Engine restart logic #85
    Feature Feedback +2
    
15. Remove the need to specify coinbase upon EVM Gateway startup #122
    Feature Feedback +2
    
16. Transactions should be optimized #123
    Feedback Improvement +2
    
17. Improve caches #119
    Feature Feedback +2
    
18. Refactor e2e tests #183
    Feature Feedback +2
    
19. Events ingested from Cadence can be out of order #197
    Feedback +1
    

[j1010001]

Remaining issue is benchmarking - keeping that separate, closing the EPIC