feat(store-sync): wait for idle after each chunk of logs in a block

[Kooshaba]

don't ask me why or how, but adding sleep(1) after calling the storageAdapter made hydration updates show up in the client. i was going crazy trying to figure out why i wasn't receiving them in the main thread, but then remembered having a similar problem in DF with how async calls were being handled. if someone actually knows the mechanism that is being abused here lmk and we can come up with a less obscure solution.

also once i started receiving updates i realized the % calculation was wrong, so fixed that too.

getting these updates is important so i can properly benchmark how long hydration takes on the sky strife end. my manual calculations on my pc are ~5 seconds.

[changeset-bot]

🦋 Changeset detected

Latest commit: a0cd05c

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 30 packages

Name	Type
@latticexyz/store-sync	Major
@latticexyz/dev-tools	Major
@latticexyz/store-indexer	Major
@latticexyz/abi-ts	Major
@latticexyz/block-logs-stream	Major
@latticexyz/cli	Major
@latticexyz/common	Major
@latticexyz/config	Major
create-mud	Major
@latticexyz/ecs-browser	Major
@latticexyz/faucet	Major
@latticexyz/gas-report	Major
@latticexyz/network	Major
@latticexyz/noise	Major
@latticexyz/phaserx	Major
@latticexyz/protocol-parser	Major
@latticexyz/react	Major
@latticexyz/recs	Major
@latticexyz/schema-type	Major
@latticexyz/services	Major
@latticexyz/solecs	Major
solhint-config-mud	Major
solhint-plugin-mud	Major
@latticexyz/std-client	Major
@latticexyz/std-contracts	Major
@latticexyz/store-cache	Major
@latticexyz/store	Major
@latticexyz/utils	Major
@latticexyz/world-modules	Major
@latticexyz/world	Major

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[holic]

Wonder if we should wait on every block or some number of iterations. Just thinking about how hydrating thousands of blocks will take significantly longer to complete if we have to wait for idle on each block.

[holic]

I think both of these code snippets might be wrong. The original intent of this was to have the percentage represent the completed state of the chunk (since we called storageAdapter above this).

I think the deleted snippet was meant to be ((i * chunkSize + chunk.length) / logs.length) * 100

And the new snippet is changing this to the "start" of the chunk (rather than "end"), so this probably should be ((i + 1) / chunks.length) * 100

[holic]

waiting on #2264 just so we can have a test that this does what we expect

[yonadaa]

I added a spec and tested on Sky Strife testnet, works great 👍

Screen.Recording.2024-02-16.at.11.24.43.mov