Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve config and docs around Experimental.AcceleratedDHTClient and Reprovider #9419

Closed
1 of 2 tasks
lidel opened this issue Nov 17, 2022 · 1 comment · Fixed by #9886
Closed
1 of 2 tasks

Improve config and docs around Experimental.AcceleratedDHTClient and Reprovider #9419

lidel opened this issue Nov 17, 2022 · 1 comment · Fixed by #9886
Assignees
Labels
help wanted Seeking public contribution on this issue topic/docs Documentation

Comments

@lidel
Copy link
Member

lidel commented Nov 17, 2022

Ref. https://github.com/ipfs/kubo/blob/master/docs/experimental-features.md#accelerated-dht-client

I think it would be useful to give an example of what user can expect when Experimental.AcceleratedDHTClient is enabled.

Initial notes

Maybe just show how expected load looks like?

Below is an example done with AcceleratedDHTClient running on a desktop PC, providing 2M of CIDs every 6 hours (Reprovider.Interval set to 6h)

2022-11-17_21-40

The above shows that the client is refreshing the map of the DHT periodically (blue "In" spikes), so it always has pretty fresh view of the network.

On a cold boot, after DHT is mapped for the first time, the node will go full throttle and start announcing Provider Records on DHT (the first orange "Out" spike).

Then, it will repeat it every Reprovider.Interval (the second orange spike after 6h).

ipfs stats provide for the above two provide sessions

TotalProvides:          4M (4,136,909)
AvgProvideDuration:     169µs
LastReprovideDuration:  5m49.762073s
LastReprovideBatchSize: 2M (2,068,471)

This should be enough for people to reason how long provide session is expected to take (AvgProvideDuration*number of CIDs)

TODO

  • land feat: increase default Reprovider.Interval #9326 first
  • create example with Reprovider.Interval set to default value from the config – this is important, so people don't copy&paste 6h, or set it to 6h because that is what official example said :)
@lidel lidel added help wanted Seeking public contribution on this issue topic/docs Documentation labels Nov 17, 2022
@MichaelMure
Copy link
Contributor

Related question: I've seen in https://github.com/ipfs/kubo/blob/master/docs/experimental-features.md#accelerated-dht-client that the accelerated DHT is not able to function as long as the first scan didn't finish. Is that still correct? Any advise to address that? I suppose some doc improvement around that (quite important) topic would help.

@BigLep BigLep moved this to 🏃‍♀️ In Progress in IPFS Shipyard Team May 30, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 1, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 2, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 2, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 2, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 2, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 2, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 2, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 7, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 7, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 7, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 7, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 8, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 8, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 8, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 8, 2023
Jorropo added a commit to Jorropo/go-ipfs that referenced this issue Jun 8, 2023
@Jorropo Jorropo closed this as completed in e7294cb Jun 8, 2023
@github-project-automation github-project-automation bot moved this from 🏃‍♀️ In Progress to 🎉 Done in IPFS Shipyard Team Jun 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Seeking public contribution on this issue topic/docs Documentation
Projects
No open projects
Archived in project
Development

Successfully merging a pull request may close this issue.

3 participants