Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rawdb,ethdb,eth: implement freezer tail deletion and use atomic refer… #577

Merged

Conversation

huyngopt1994
Copy link
Collaborator

@huyngopt1994 huyngopt1994 commented Sep 17, 2024

ethereum/go-ethereum#23954 Reference by This PR

some highlights for those changes.

  • Producing the truncateTail implementing in per table in freezer data
  • Rename TruncateAncients -> TruncateHead
  • Produce storing metadata information per table stored in disk for keeping track of virtualTail, which like soft delete, keeps deleted items in memory, the truncateTail cleaning up will happen in disk with file unit for avoiding reindex logic.
  • The truncate logic is complex when it need to update index entries in index file before starting real truncating data files in disk.
  • In the next implementing, It will produce the other subfolder for storing ancient
    stateFreezerName = "state" // the folder name of reverse diff ancient store. Which use this truncateTail frequently

@huyngopt1994 huyngopt1994 force-pushed the implement-freezer-tail-deletion branch 4 times, most recently from 06b47c6 to d88adc9 Compare September 18, 2024 07:05
@huyngopt1994 huyngopt1994 force-pushed the implement-freezer-tail-deletion branch from d88adc9 to be08ccd Compare September 18, 2024 08:50
core/rawdb/freezer_table.go Show resolved Hide resolved
core/rawdb/freezer_table.go Show resolved Hide resolved
core/rawdb/freezer_table.go Show resolved Hide resolved
@huyngopt1994 huyngopt1994 merged commit ca6e07f into path-base-implementing Sep 19, 2024
1 check passed
@huyngopt1994 huyngopt1994 deleted the implement-freezer-tail-deletion branch September 19, 2024 10:12
huyngopt1994 added a commit that referenced this pull request Oct 25, 2024
huyngopt1994 added a commit that referenced this pull request Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants