Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve masp scan speed #2957

Closed
opsecx opened this issue Mar 26, 2024 · 1 comment
Closed

Improve masp scan speed #2957

opsecx opened this issue Mar 26, 2024 · 1 comment

Comments

@opsecx
Copy link

opsecx commented Mar 26, 2024

suggestions to improve masp scan speed (shielded sync):

  • if sync fails on fetch (where currently it's highly volatile), have a cache of already fetched data, so it can continue where it left off before halt or
  • make sync more resistant to timeouts
  • use several cpu threads on scan step after having fetched data. atm the scan part is too "nice" on system resources. this will obviously not improve scan on order/scale (O(n)), but will still cut down time to a lesser factor.

(will be submitting some of these ideas as s-class so don't bother if you see this. if someone else has already suggested these steps lmk and I'll retract)

@brentstone
Copy link
Collaborator

Will close this here, but tracking in #2900.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants