Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test vec binary #15

Closed
wants to merge 33 commits into from
Closed

test vec binary #15

wants to merge 33 commits into from

Conversation

cheme
Copy link
Contributor

@cheme cheme commented Jun 24, 2024

simple binary to produce and checks json test vec.

currently I skip all package that cannot be split in 64 byte shard (for the erasure coding of variable size package, not segments, in case of segments I pad to a 4096 segments).
For package ec I am using 341 * 3 chunks as output.
For segments I am using 342 * 3 chunks as output.

!!! this PR also switch the hash from blake2b512 to blake2b256

@charliewinston14
Copy link

charliewinston14 commented Nov 27, 2024

@cheme How can SubShardEncoder be used for variable width data? Right now construct_subshards is expecting a const for the size so we can't pass in a dynamic size?

@cheme
Copy link
Contributor Author

cheme commented Dec 2, 2024

n't pass in a dyna

Indeed it was only for constant size data (smaller data should be padded, bigger data split to constant size).
Note that this code is likely not in use anymore (I did not follow the latest changes about erasure coding spec).

@cheme
Copy link
Contributor Author

cheme commented Dec 2, 2024

Superseded by jam internal code.

@cheme cheme closed this Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants