[RELEASE] cugraph v21.12 #1970
Merged
[RELEASE] cugraph v21.12 #1970
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
Fix automerger for `branch-21.12`
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
[gpuCI] Forward-merge branch-21.10 to branch-21.12 [skip gpuci]
CI testing on A100 is detecting a segmentation fault in the WCC implementation. We currently can't get developer access to an A100 in order to debug this. This PR will disable the WCC test. Once we can resolve the A100 issue we can enable this test again. Authors: - Chuck Hastings (https://github.com/ChuckHastings) - Rick Ratzel (https://github.com/rlratzel) Approvers: - Brad Rees (https://github.com/BradReesWork) - AJ Schmidt (https://github.com/ajschmidt8) URL: #1870
…es, C library helpers (#1799) Initial cuGraph C API: * C-API for Biased RW and supporting C library helpers. * cmake updates to build the new object files and library using the appropriate compiler (`g++` or `gcc`) accordingly. * C tests written without gtests to ensure a pure-C application build works. * updated CI scripts to build and run the new tests. The Python API for the updated Biased RW will be done in a separate PR. Authors: - Andrei Schaffer (https://github.com/aschaffer) - Rick Ratzel (https://github.com/rlratzel) Approvers: - AJ Schmidt (https://github.com/ajschmidt8) - Chuck Hastings (https://github.com/ChuckHastings) - Rick Ratzel (https://github.com/rlratzel) URL: #1799
Changes to be in-line with: rapidsai/cudf#9307 Authors: - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - AJ Schmidt (https://github.com/ajschmidt8) URL: #1849
No need to instantiate for vertex_t=int64_t and edge_t=int32_t Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1878
Dask workers should be using local space instead of shared filesystem Authors: - Joseph Nke (https://github.com/jnke2016) Approvers: - Rick Ratzel (https://github.com/rlratzel) URL: #1879
Partially addresses #1753 Creates a new C++ function to extract BFS paths. This PR includes the SG implementation and the SG unit tests. A separate PR will provide the MG unit test. Authors: - Chuck Hastings (https://github.com/ChuckHastings) Approvers: - Seunghwa Kang (https://github.com/seunghwak) URL: #1838
#1870 disabled some tests to allow us to push some things through CI. While investigating this issue we discovered that we are having problem compiling the code in a container that uses the delivered 11.0 thrust. This PR is a different temporary workaround. We force downloading the desired version of thrust to be used as part of the cugraph build. The PR also reactivates all of the WCC testing. Authors: - Chuck Hastings (https://github.com/ChuckHastings) Approvers: - Brad Rees (https://github.com/BradReesWork) - Robert Maynard (https://github.com/robertmaynard) URL: #1883
- Added testing for copy_v_transform_reduce_out_nbr primitive. - Fixed bug in copy_v_transform_reduce_in_out_nbr kernels. - Fix initial value set up in primitives. Authors: - Kumar Aatish (https://github.com/kaatish) Approvers: - Seunghwa Kang (https://github.com/seunghwak) - Chuck Hastings (https://github.com/ChuckHastings) URL: #1856
- [x] implement symmetrize_edgelist - [x] implement graph_t::symmetrize() using symmetrize_edgelist - [x] implement C++ test cases Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1833
- [x] implement transpose_edgelist - [x] implement graph_t::transpose() using transpose_edgelist - [x] implement C++ test cases Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Rick Ratzel (https://github.com/rlratzel) - Chuck Hastings (https://github.com/ChuckHastings) URL: #1834
Update cuGraph documentation and examples closes #1862 Authors: - Joseph Nke (https://github.com/jnke2016) Approvers: - Brad Rees (https://github.com/BradReesWork) - Rick Ratzel (https://github.com/rlratzel) URL: #1866
This is necessary for implementing Node2Vec and triangle counting (and also improves edge traversal performance as this improves locality of row/column property accesses). Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Andrei Schaffer (https://github.com/aschaffer) - Chuck Hastings (https://github.com/ChuckHastings) URL: #1886
Moved compute_major_degrees from a include/cugraph/detail/graph_utils.cuh to src/structure/graph_view_impl.cuh as this is used nowhere else. Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1888
Authors: - Jordan Jacobelli (https://github.com/Ethyling) Approvers: - Peter Andreas Entschev (https://github.com/pentschev) - AJ Schmidt (https://github.com/ajschmidt8) URL: #1895
…ive input argument check for graph_view_t (#1890) Close #1892 - [x] Check for graph properties passed by the caller (multigrpah, symmetric). - [x] Remove expensive check for graph_view_t (graph_view_t is not to be called by user, only called by graph_t) Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1890
Close #1896 Check num_edges == 0 before sorting adjacency list (num_chunks becomes -1 if num_edges = 0). Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1897
The WCC/SCC was old and examples did not consider renumbering Authors: - Brad Rees (https://github.com/BradReesWork) Approvers: - Taurean Dyer (https://github.com/taureandyernv) - Rick Ratzel (https://github.com/rlratzel) URL: #1893
Workers having no data after shuffling end up holding empty columns(series) of type object which are not supported by `__cuda_array_interface__` Ensure that the empty columns have the appropriate dtype Authors: - Joseph Nke (https://github.com/jnke2016) - Rick Ratzel (https://github.com/rlratzel) Approvers: - Brad Rees (https://github.com/BradReesWork) - Rick Ratzel (https://github.com/rlratzel) URL: #1926
…ll and P is large (#1919) This PR pulls updates from #1916 & #1917. Better be reviewed after #1916 ݽ gets merged. (key, value) pairs are still disabled (by setting the threshold value to 0) as this has performance overhead and no clear benefit in analyzing larger graphs up to 32 GPUs (unless we artificially tweak 2D partitioning of GPUs). The threshold value needs to be adjusted with larger scale testing later. - [x] Update copy_v_transform_reduce_in_out_nbr to use minor_properties_t as a temporary buffer. Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1919
Partially addresses #1909. - [x] Add a K-core function declaration. Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) - Rick Ratzel (https://github.com/rlratzel) URL: #1924
…tion (#1934) Necessary for #1909 Add options to filter out self-loops & multi-edges after edge generation and before graph creation in C++ test graph generation API. Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1934
Close #537 Count the number of self-loops & multi-edges. - [x] API update - [x] Implement count self-loops - [x] Implement count multi-edges - [x] Add C++ test suites. Authors: - Seunghwa Kang (https://github.com/seunghwak) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) - Kumar Aatish (https://github.com/kaatish) URL: #1939
…entation (#1941) Followup PR to #1930 This PR re-enables HITS in the python API using the new C++ primitive-based implementation. This also refactors the tests to use the benchmark fixture plugin, and adds an additional dataset to read for more diverse comparison to Nx.  Authors: - Rick Ratzel (https://github.com/rlratzel) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) - Brad Rees (https://github.com/BradReesWork) - Joseph Nke (https://github.com/jnke2016) URL: #1941
Depends on rapidsai/raft#356 Authors: - Divye Gala (https://github.com/divyegala) Approvers: - Rick Ratzel (https://github.com/rlratzel) - Chuck Hastings (https://github.com/ChuckHastings) - Seunghwa Kang (https://github.com/seunghwak) URL: #1937
Close #1909. This PR aims to implement K-core only for undirected graphs. - [x] Implement K-core implementation - [x] Test/debug on SG - [x] Test/debug on MG Authors: - Seunghwa Kang (https://github.com/seunghwak) - Kumar Aatish (https://github.com/kaatish) - Divye Gala (https://github.com/divyegala) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) - Kumar Aatish (https://github.com/kaatish) URL: #1933
A bug was reported when calling a MNMG algo with unrenumbered edge list. This PR returns an error if `renumber=False ` Change the algo name for asv reporting closes #1936 Authors: - Joseph Nke (https://github.com/jnke2016) Approvers: - Rick Ratzel (https://github.com/rlratzel) URL: #1943
Implementation of the following capabilities into the C API: * Graph creation * Pagerank * BFS Note that the C API in this implementation supports: * Renumbering in the C layer * Transposing the graph if necessary to support the desired algorithm Closes #1906 Authors: - Chuck Hastings (https://github.com/ChuckHastings) Approvers: - Seunghwa Kang (https://github.com/seunghwak) - Kumar Aatish (https://github.com/kaatish) URL: #1940
Close #1911 - [x] Implement the new primitive extract_if_e to extract an edge list (to construct a subgraph) by filtering the edges with ```e_op``` - [x] Implement test suites. Authors: - Seunghwa Kang (https://github.com/seunghwak) - Divye Gala (https://github.com/divyegala) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1938
The new renumbering implementation will require C++ integration directly with cudf. In order to facilitate that, but also support our customers that won't need cudf, this PR will create a separate library (`libcugraph_etl.so`) which will ultimately link with `libcudf.so` and contain the ETL portions of cugraph that require cudf features. This way our other libcugraph customers that don't need to reference the new library will not need to install all of the cudf dependencies. To seed this, the PR also includes a proposed API for the new renumbering capability. Authors: - Chuck Hastings (https://github.com/ChuckHastings) - Rick Ratzel (https://github.com/rlratzel) Approvers: - Seunghwa Kang (https://github.com/seunghwak) - https://github.com/chirayuG-nvidia - Rick Ratzel (https://github.com/rlratzel) - Jordan Jacobelli (https://github.com/Ethyling) URL: #1885
This PR updates the `conda` recipe build strings and `cudatoolkit` version specifications as part of the Enhanced Compatibility efforts. The build strings have been updated to only include the major CUDA version (i.e. `librmm-21.12.00a-cuda11_gc781527_12.tar.bz2`) and the `cudatoolkit` version specifications will now be formatted like `cudatoolkit >=x,<y.0a0` (i.e. `cudatoolkit >=11,<12.0a0`). Moving forward, we'll build the packages with a single CUDA version (i.e. `11.4`) and test them in environments with different CUDA versions (i.e. `11.0`, `11.2`, `11.4`, etc.). Authors: - AJ Schmidt (https://github.com/ajschmidt8) Approvers: - Ray Douglass (https://github.com/raydouglass) URL: #1889
Authors: - Robert Maynard (https://github.com/robertmaynard) Approvers: - Chuck Hastings (https://github.com/ChuckHastings) URL: #1945
This upgrade is required to be in-line with: rapidsai/cudf#9716 Depends on: rapidsai/integration#390 Authors: - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - Ray Douglass (https://github.com/raydouglass) - Brad Rees (https://github.com/BradReesWork) URL: #1949
Fix Changelog Merge Conflicts for `branch-21.12`
Starting with CUDA 11.1, cusolver updated the major SOVERSION from 10 to 11. To allow execution with the cudatoolkit=11.0 we need to package the ABI 11 version. Authors: - Robert Maynard (https://github.com/robertmaynard) Approvers: - Brad Rees (https://github.com/BradReesWork) - Rick Ratzel (https://github.com/rlratzel) - AJ Schmidt (https://github.com/ajschmidt8) URL: #1954
Changes to be in-line with: rapidsai/cudf#9734 Authors: - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - Brad Rees (https://github.com/BradReesWork) - Jordan Jacobelli (https://github.com/Ethyling) URL: #1958
…ity (#1968) Updates to `libcugraph_etl` conda recipe for CUDA Enhanced Compatibility. These were not tested locally. Authors: - Rick Ratzel (https://github.com/rlratzel) Approvers: - AJ Schmidt (https://github.com/ajschmidt8) URL: #1968
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
|
rerun tests |
BradReesWork
approved these changes
Dec 1, 2021
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
❄️ Code freeze for
branch-21.12and v21.12 releaseWhat does this mean?
Only critical/hotfix level issues should be merged into
branch-21.12until release (merging of this PR).What is the purpose of this PR?
branch-21.12intomainfor the release