Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use streaming for storage API #1

Open
ecausarano opened this issue Aug 28, 2016 · 0 comments
Open

Use streaming for storage API #1

ecausarano opened this issue Aug 28, 2016 · 0 comments

Comments

@ecausarano
Copy link
Owner

ecausarano commented Aug 28, 2016

Right now all network and storage handling of bundles is done by allocating and copying around byte arrays. It's an unacceptable design, eats gobs of memory and kills the program the very moment it's used beyond trivial tests.

Rewrite the storage API to used buffered RW so that network can RW using known size limited size buffers.

https://docs.oracle.com/cd/E17276_01/html/java/com/sleepycat/db/SecondaryMultiKeyCreator.html one could introduce a concurrent map indexed on the key, fetch the current the state of the processor update and save the results set.

Q is: when is it "done"? Does the runtime handle it when committing the transaction?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant