Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

storage: prototype and evaluate expected inflation of Raft proposal sizes #6285

Closed
tbg opened this issue Apr 25, 2016 · 1 comment
Closed
Assignees

Comments

@tbg
Copy link
Member

tbg commented Apr 25, 2016

See #6166. We want to get a good idea of the proposal sizes which typical (and perhaps pathological) workloads generate. This size is (for all practical purposes) dictated by the size of the generated WriteBatch representation.

@tbg tbg self-assigned this May 10, 2016
@tbg
Copy link
Member Author

tbg commented May 11, 2016

No real surprises here. I looked at batch puts, and surprise surprise the repr size scales like (keyBytes+valBytes). More concretely, a raw payload of 10 value bytes and an 8-byte key wound up about double that in the repr (but that includes MVCC overhead, etc). 100000 * 18kb gave a ~352KiB repr.

DeleteRange is similarly without surprises. The nice thing here is that the deleted values don't matter - it's always O(encoded keySize).

All of this is obvious from the encoding, so this was really just a sanity check. If there's anything else worth looking at, ping this issue. Numbers are from the (hacky) fiddle-6285 branch.

@tbg tbg closed this as completed May 11, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant