Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Arweave Upload microservice #1

Merged
merged 518 commits into from
Nov 29, 2022
Merged

Add Arweave Upload microservice #1

merged 518 commits into from
Nov 29, 2022

Conversation

MantisClone
Copy link
Collaborator

@MantisClone MantisClone commented Nov 10, 2022 •
edited
Loading

Closes #2

Changes proposed in this PR

  • Add Arweave Upload microservice

Tests

CI Checks are not setup on the target repo. Please instead refer to the latest test run on the source repo: https://github.com/MantisClone/dbs_arweave/actions/runs/3433119411/jobs/5723261035

Out-of-scope, future enhancements:

Please see "Out-of-scope, future enhancements" column in the project tracker
https://github.com/users/MantisClone/projects/1/views/1

Addtional Resources

  1. Project Spec: Arweave microservice #2
  2. Gantt Chart: https://docs.google.com/spreadsheets/d/1Fm86eZ_K2ClfxCT36UcFJc6SInfHQrXQs3mGl_2iVlY/edit#gid=1115838130
  3. Working Repo: https://github.com/MantisClone/arweave-upload
  4. Fork Repo: https://github.com/MantisClone/dbs_arweave
  5. Delivery Repo: https://github.com/oceanprotocol/dbs_arweave

MantisClone and others added 30 commits October 27, 2022 10:16
@MantisClone
Try again to print responses
76d0db3
@MantisClone
Make request and response logs pretty
779fecc
@MantisClone
Remove extra pretty spacing because it splits logs across many lines
9d78af0
@MantisClone
Add spaces for readibility
68e3b5e
@MantisClone
Add expect statments
8828819
@MantisClone
Increase upload time to 2 minutes
07e1c37
@MantisClone
Add timeoutSeconds to easily set timeout in seconds
86085a8
@MantisClone
Fix expect
a8f2b9f
@MantisClone
Expect data to be empty string ''
17c6fd5
@MantisClone
Remove status log
6f6de5e
@MantisClone
Merge pull request oceanprotocol#56 from MantisClone/55-ci-failure-on…
86b7646 
…-main
@corrie-sloot
Fix bug in conversion of large numbers
db7152c
@corrie-sloot
Revert "Fix bug in conversion of large numbers"
cad7dc9 
This reverts commit db7152c.
@corrie-sloot
Better fix for large numbers.
9730de2
@corrie-sloot
Merge branch 'bignumber-fix' of https://github.com/MantisClone/arweav…
78c8268 
…e-upload into bignumber-fix
@MantisClone
Add large file getQuote test
87371ce
@MantisClone
Add missing return
43936c2
@corrie-sloot
Merge pull request oceanprotocol#62 from MantisClone/bignumber-fix
480136a 
Bignumber fix
@MantisClone
Merge branch 'main' into 63-fix-missing-return-statement-quotecontrol…
688596f 
…lerjs-line-46-errorresponsereq-res-400-invalid-useraddress
@MantisClone
Merge pull request oceanprotocol#64 from MantisClone/63-fix-missing-r…
15e713e 
…eturn-statement-quotecontrollerjs-line-46-errorresponsereq-res-400-invalid-useraddress
@MantisClone
Merge branch 'main' into 21-add-more-quote-status-codes-to-indicate-f…
b1acb77 
…ailure-modes
@MantisClone
Add invalid nonce test
18642d7
@MantisClone
Fix test name
c7462e9
@MantisClone
Try move old_nonce to outer scope, try fix error
1e5341d 
  - Error: Cannot set headers after they are sent to the client
@MantisClone
[REVERT THIS] Only do old nonce test
a77f863
@MantisClone
Use await to wait for db to return old_nonce
4355a33
@MantisClone
Add console logs
a6d1b1b
@corrie-sloot
Changout sqlite3 model with better-sqlite3
542df41
@corrie-sloot
db file does not need to exist
b3dff9d
@corrie-sloot
fix getStatus
02b858a
corrie-sloot and others added 23 commits November 7, 2022 14:55
@corrie-sloot
Variables are getting through now.
cf7856b
@MantisClone
Move comment closer to relevant line
614b020
@MantisClone
Increase timeouts (transactions are slower on Goerli)
d97ee7c
@MantisClone
Add PRICE_BUFFER config. Default to 10%, set CI to use 20% (for Goerli)
b43ff3a 
  - This will hopefully fix error:
  	```
    Error occurred while uploading file: Error: Not enough funds to send data. CID = ipfs://bafybeigdyrzt5sfp7udm7hu76uh7y26nf3efuylqabf3oclgtqy55fbzdi, file index = 0
    ```
@MantisClone
Remove temporary test to verify CHAIN_ID and TOKEN_ADDRESS set correctly
e0f92b8
@MantisClone
Increase timeout for all "approval" tests to 200
1940c8e 
  - Remove unnecessary code in "upload with old nonce" test
@corrie-sloot
If MAX_UPLOAD_SIZE is zero, ignore file length checks
a08e275
@MantisClone
Merge pull request #82 from MantisClone/69-test-on-goerli-mumbai
3e80a7a
@MantisClone
Merge branch 'main' into 84-handle-unlimited-uploads
85b0e9b
@MantisClone
Increse PRICE_BUFFER to 30%
b05855f
@MantisClone
Split PRICE_BUFFER to BUNDLR_PRICE_BUFFER and GAS_PRICE_BUFFER
eb3b4f4
@MantisClone
Merge pull request #85 from MantisClone/84-handle-unlimited-uploads
e5983fd
@MantisClone
Update README
168d976
@MantisClone
Fixes
adc7d69
@MantisClone
Fix
5a3c4c9
@MantisClone
Fixes
3c1b58d
@MantisClone
Merge branch 'main' of github.com:MantisClone/dbs_arweave
b6379de
@MantisClone
Update README.md
a1ebdee
@MantisClone
Update README.md
c0007c7
@MantisClone
Update package.json
3f5d94a
@MantisClone
Update package.json
417dafa
@MantisClone
Update README.md
e029cdc
@MantisClone
Update package.json
e91c4eb
@MantisClone MantisClone added the Type: Enhancement New feature or request label Nov 10, 2022
@MantisClone MantisClone marked this pull request as ready for review November 10, 2022 01:12
@alexcos20 alexcos20 merged commit 513b521 into oceanprotocol:main Nov 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@alexcos20 alexcos20 Awaiting requested review from alexcos20

@LoznianuAnamaria LoznianuAnamaria Awaiting requested review from LoznianuAnamaria

Assignees

@MantisClone MantisClone

@corrie-sloot corrie-sloot

Labels
Type: Enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Arweave microservice
3 participants
@MantisClone @alexcos20 @corrie-sloot