Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REVIEW] Apply modifications to account for RAFT changes #1707

Merged
merged 21 commits into from
Aug 27, 2021

Conversation

viclafargue
Copy link
Contributor

@viclafargue viclafargue commented Jul 13, 2021

@viclafargue viclafargue requested a review from a team as a code owner July 13, 2021 14:20
@BradReesWork BradReesWork added 3 - Ready for Review improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Jul 13, 2021
@BradReesWork BradReesWork added this to the 21.08 milestone Jul 13, 2021
Copy link
Collaborator

@ChuckHastings ChuckHastings left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This addresses the changes prior to rapidsai/raft#286. Once that PR is merged, couldn't a bunch of these changes eliminate the inclusion of rmm/exec_policy.hpp and simply use handle.get_thrust_policy()?

It seems a shame to make all of these changes and later go back and remake all of these changes a little differently.

cpp/include/cugraph/dendrogram.hpp Outdated Show resolved Hide resolved
cpp/src/community/ktruss.cu Outdated Show resolved Hide resolved
@viclafargue
Copy link
Contributor Author

Thank you for your review @ChuckHastings! At first, we planned to do minimal modifications to make the code to compile with the newest RAFT changes and to make a deeper change later on. However, as you said, it's probably better to include the exec_policy changes in this PR. That's what I just did.

@viclafargue
Copy link
Contributor Author

Tagging you @afender to raise awareness on the ongoing changes in RAFT, RMM, as well as this cuGraph PR that glues everything together. Hoping these don't break anything in cuGraph.

@BradReesWork BradReesWork modified the milestones: 21.08, 21.10 Jul 19, 2021
@viclafargue viclafargue changed the base branch from branch-21.08 to branch-21.10 July 19, 2021 16:31
@BradReesWork
Copy link
Member

@viclafargue @ChuckHastings This PR is getting old and further out of sync - lots of conflicts. Can we either get it updated or closed?

@ChuckHastings
Copy link
Collaborator

This can't be merged until the RAFT PR is done. Perhaps @viclafargue has some insight into a time frame for when the raft work will be complete.

There's a bunch of changes going into cugraph that will make these diverge even more.

@viclafargue
Copy link
Contributor Author

@BradReesWork @ChuckHastings, the concurrent merge of changes in RMM, RAFT, cuGraph and cuML is planned for the end of this week or next week. I'll soon be working on updating this PR.

cpp/cmake/thirdparty/get_cuhornet.cmake Outdated Show resolved Hide resolved
cpp/include/cugraph/detail/graph_utils.cuh Outdated Show resolved Hide resolved
cpp/include/cugraph/detail/graph_utils.cuh Outdated Show resolved Hide resolved
Copy link
Contributor

@seunghwak seunghwak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you very much for helping us to resolve this issue, and this PR looks really good except for the sssp.cu file in the experimental directory. The file has moved to the traversal directory as I commented below.

cpp/src/experimental/sssp.cu Outdated Show resolved Hide resolved
Copy link
Collaborator

@ChuckHastings ChuckHastings left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking almost ready... a couple of comments.

@@ -42,6 +42,6 @@ set(CUGRAPH_BRANCH_VERSION_raft "${CUGRAPH_VERSION_MAJOR}.${CUGRAPH_VERSION_MINO
# To use a different RAFT locally, set the CMake variable
# RPM_raft_SOURCE=/path/to/local/raft
find_and_configure_raft(VERSION ${CUGRAPH_MIN_VERSION_raft}
FORK rapidsai
PINNED_TAG branch-${CUGRAPH_BRANCH_VERSION_raft}
FORK viclafargue
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just noting... this will be switched back once the RAFT PR is merged.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, just for testing. Thanks for putting a reminder

cpp/src/community/legacy/egonet.cu Outdated Show resolved Hide resolved
@viclafargue viclafargue requested a review from a team as a code owner August 23, 2021 17:17
Copy link
Member

@ajschmidt8 ajschmidt8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving ops-codeowner file changes

@viclafargue
Copy link
Contributor Author

rerun tests

@codecov-commenter
Copy link

codecov-commenter commented Aug 25, 2021

Codecov Report

Merging #1707 (b40e752) into branch-21.10 (bf64c2c) will decrease coverage by 0.16%.
The diff coverage is n/a.

❗ Current head b40e752 differs from pull request most recent head b0581d0. Consider uploading reports for the commit b0581d0 to get more accurate results
Impacted file tree graph

@@               Coverage Diff                @@
##           branch-21.10    #1707      +/-   ##
================================================
- Coverage         59.85%   59.68%   -0.17%     
================================================
  Files                77       77              
  Lines              3547     3567      +20     
================================================
+ Hits               2123     2129       +6     
- Misses             1424     1438      +14     
Impacted Files Coverage Δ
python/cugraph/centrality/katz_centrality.py 89.47% <ø> (ø)
python/cugraph/dask/common/part_utils.py 20.16% <ø> (ø)
python/cugraph/dask/link_analysis/pagerank.py 18.60% <ø> (-1.99%) ⬇️
python/cugraph/layout/force_atlas2.py 55.55% <ø> (+5.55%) ⬆️
python/cugraph/link_analysis/pagerank.py 96.00% <ø> (-4.00%) ⬇️
python/cugraph/utilities/nx_factory.py 86.88% <ø> (+0.92%) ⬆️
python/cugraph/community/__init__.py 70.37% <0.00%> (-18.52%) ⬇️
... and 4 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 80a3459...b0581d0. Read the comment docs.

rapids-bot bot pushed a commit that referenced this pull request Aug 25, 2021
PR essentially backports the fixes in #1707 for the deprecated RMM exec policy, and unpins the RMM nighlty to unblock local builds and CI and local development. Conflicts with the bigger PR should be minimal, and mainly around a single change:

```
rmm::exec_policy(handle.get_stream())
```

to 

```
handle.get_thrust_policy()
```

Authors:
  - Dante Gama Dessavre (https://github.com/dantegd)

Approvers:
  - AJ Schmidt (https://github.com/ajschmidt8)
  - Chuck Hastings (https://github.com/ChuckHastings)
  - Seunghwa Kang (https://github.com/seunghwak)

URL: #1789
@viclafargue
Copy link
Contributor Author

rerun tests

@ChuckHastings
Copy link
Collaborator

@gpucibot merge

@rapids-bot rapids-bot bot merged commit 65ca876 into rapidsai:branch-21.10 Aug 27, 2021
dantegd added a commit to dantegd/cugraph that referenced this pull request Aug 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants