Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QST] How to parallelize SSSP shortest path evaluation #1320

Closed
mughetto opened this issue Jan 5, 2021 · 3 comments
Closed

[QST] How to parallelize SSSP shortest path evaluation #1320

mughetto opened this issue Jan 5, 2021 · 3 comments
Assignees
Labels
question Further information is requested
Milestone

Comments

@mughetto
Copy link

mughetto commented Jan 5, 2021

Hey,

I'm currently working with a 44k x 44k adjacency matrix for which I'd like to compute the shortest path for each pair of nodes.

Using cugraph.traversal.sssp.shortest_path_length(G, source) I can easily find all 44k shortest path toward a given source. (where G is a sparse COO matrix)

But when I try to naively loop (for i in range()) over the 44k possible sources it takes 2 hours to complete and I'm pretty sure there is something better to do there.

What would be the suggested way to efficiently run SSSP over the full set of sources?

Thanks a lot for your insights!

@mughetto mughetto added ? - Needs Triage Need team to review and classify question Further information is requested labels Jan 5, 2021
@BradReesWork BradReesWork removed the ? - Needs Triage Need team to review and classify label Jan 5, 2021
@BradReesWork BradReesWork added this to the 0.18 milestone Jan 5, 2021
@BradReesWork BradReesWork self-assigned this Jan 5, 2021
@BradReesWork
Copy link
Member

@mughetto the current problem is that each loop requires a new kernel lunch. We are in the process of fix that performance issue. Additionally we are working on adding a all-pair shortest path function. The first part (performance) is something we are trying to get into the current 0.18 release. The ASAP (or ASSP) will be spring

@mughetto
Copy link
Author

mughetto commented Jan 5, 2021

Thanks a lot for the clarification @BradReesWork !

Is there an issue where I could track progress and eventually help with?

@BradReesWork
Copy link
Member

issue #957

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants