You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
once we have better sparse handling inside borg (communicating data vs. hole status between chunker, hashing, ...), it makes sense to add a sparsify functionality.
this is implemented by #5620 within the buzhash and fixed chunker.
currently, the chunker detects zeros and yields as described above.
the hasher maintains a LRU cache of (hashalgo, size_of_allzero_chunk) -> hashvalue to avoid computing hashes of all-zero chunks again and again.
note that this does not affect storage (yet?) because in any case, borg will compress and store the zeros as if they were normal data. so the archived item does not know what was a sparse hole or fallocated unused space or just normally on-disk zeros.
related to #14:
once we have better sparse handling inside borg (communicating data vs. hole status between chunker, hashing, ...), it makes sense to add a sparsify functionality.
assume we read all-zero chunks from a file:
for the last 2 cases, we could add a
--sparsify
toborg create
:just compare the chunk content to an all-zero bytearray.
if it compares equal and
--sparsify
was given, the chunker shall (at least) yield "this is a hole of length X".later it could yield (if we can detect somehow):
The text was updated successfully, but these errors were encountered: