Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove all temp file generation for deals #4929

Merged
merged 3 commits into from
Nov 23, 2020

Conversation

hannahhoward
Copy link
Contributor

@hannahhoward hannahhoward commented Nov 20, 2020

Goals

Reduce space required for temporary storage by generating CommP in pieces and removing use of temporary files in markets for online deals (still there for offline deals for now)

Implementation

  • Extracts commP writer (as well as zerocomm and a couple other utilities) to go-commp-utils, which also now includes pieceio
  • Uses updated markets

For discussion

I removed any internal copies of the code in go-commp-utils. However, for the ffiwrapper, which is only a partial extraction, it results in some slightly awkward imports. Alternatively, we could just live with the extra copies of the files.

fix #4898 fix #4899

Copy link
Contributor

@dirkmc dirkmc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@hannahhoward hannahhoward force-pushed the feat/update-markets-commp-extraction branch from 198596b to 6a5783a Compare November 20, 2020 21:08
@hannahhoward hannahhoward force-pushed the feat/update-markets-commp-extraction branch from 6a5783a to 218f7c2 Compare November 20, 2020 21:29
@magik6k magik6k merged commit 0e39e76 into master Nov 23, 2020
@magik6k magik6k deleted the feat/update-markets-commp-extraction branch November 23, 2020 17:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants