-
Notifications
You must be signed in to change notification settings - Fork 315
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cugraph-Service Remote Graphs and Algorithm Dispatch #2832
Cugraph-Service Remote Graphs and Algorithm Dispatch #2832
Conversation
Currently, this only does SG version for rapidsai#2401. MG is still TODO. This also doesn't change anything user-facing (yet).
This includes a slow workaround for rapidsai/cudf#11550
…nto cgs-remote-wrappers
…to cgs-remote-wrappers
…to cgs-remote-sample
…to cgs-remote-sample
rerun tests |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good, I like how the consolidation of G and PG is happening in RemoteGraph. I just had a few comments/questions.
python/cugraph_service/cugraph_service_client/remote_graph_utils.py
Outdated
Show resolved
Hide resolved
python/cugraph_service/cugraph_service_server/cugraph_handler.py
Outdated
Show resolved
Hide resolved
python/cugraph_service/cugraph_service_server/cugraph_handler.py
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have requested changes around dask stuff looks good other-wise .
python/cugraph_service/cugraph_service_server/cugraph_handler.py
Outdated
Show resolved
Hide resolved
python/cugraph_service/cugraph_service_server/cugraph_handler.py
Outdated
Show resolved
Hide resolved
python/cugraph_service/cugraph_service_server/cugraph_handler.py
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM .
@gpucibot merge |
Fixes the currently-broken `pyg_hetero_mag` notebook, which fails due to the sampling output not matching what the API expects. Note: this does use an optional import of PyG, similar to how other code optionally uses `torch` or `cudf`. Also adds an in-place `fillna` function for `PropertyGraph` and `MGPropertyGraph`. There is a separate issue to do this for `RemoteGraph` (rapidsai/graph_dl#97). Also removes an unintended dependence on `cugraph` by adding `is_multi_gpu()` methods to `PropertyGraph` and `MGPropertyGraph` so whether a graph is MG can be determined without importing `cugraph`. Closes rapidsai/graph_dl#78 Closes rapidsai/graph_dl#77 Closes rapidsai/graph_dl#63 Merge after #2832 Authors: - Alex Barghi (https://github.com/alexbarghi-nv) - Erik Welch (https://github.com/eriknw) Approvers: - Rick Ratzel (https://github.com/rlratzel) - Erik Welch (https://github.com/eriknw) URL: #2860
Resolves https://github.com/rapidsai/graph_dl/issues/80
This PR combines
RemoteGraph
andRemotePropertyGraph
, adds support for remote API calls to cugraph.Graph, adds subgraph extraction to the property graph wrappers, adds the ability to dispatch cuGraph algorithms (though currently onlyuniform_neighbor_sample
is supported), better supports multigraphs for subgraph extraction, properly handles renumbering on the server, and supports implicit subgraph extraction for remote graphs.