-
Notifications
You must be signed in to change notification settings - Fork 915
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use stream allocator adaptor for hash join table #9704
Use stream allocator adaptor for hash join table #9704
Conversation
Current CMake changes are dedicated to CI tests only. Will update the main branch git tag once NVIDIA/cuCollections#119 is merged. |
Codecov Report
@@ Coverage Diff @@
## branch-22.02 #9704 +/- ##
================================================
- Coverage 10.49% 10.44% -0.05%
================================================
Files 119 119
Lines 20305 20422 +117
================================================
+ Hits 2130 2133 +3
- Misses 18175 18289 +114
Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good.
Holding this until dependent PR is merged.
@@ -21,7 +21,7 @@ function(find_and_configure_cucollections) | |||
cuco 0.0 | |||
GLOBAL_TARGETS cuco::cuco | |||
CPM_ARGS GITHUB_REPOSITORY NVIDIA/cuCollections | |||
GIT_TAG f0eecb203590f1f4ac4a9f1700229f4434ac64dc | |||
GIT_TAG 6433e8ad7571f14cc5384051b049029c60dd1ce0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If the dependency PR is already merged, shouldn't this GIT_TAG be removed and just depend on a release branch?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cuco doesn't have a release yet thus we choose to fetch a specific commit instead of the main branch (dev
).
@harrism @karthikeyann please re-review. |
@gpucibot merge |
The `concurrent_unordered_multimap` is no longer used in libcudf. It has been replaced by `cuco::static_multimap`. The majority of the refactoring was done in PRs #8934 and #9704. A similar effort is in progress for `concurrent_unordered_map` and `cuco::static_map` in #9666 (and may depend on porting some optimizations from libcudf to cuco -- need to look into this before doing a direct replacement). This partially resolves issue #10401. cc: @PointKernel @vyasr Authors: - Bradley Dice (https://github.com/bdice) Approvers: - Yunsong Wang (https://github.com/PointKernel) - Vyas Ramasubramani (https://github.com/vyasr) - Jake Hemstad (https://github.com/jrhemstad) URL: #10642
Depends on NVIDIA/cuCollections#119
This PR replaces the default hash join allocator with the corresponding
rmm::mr::stream_allocator_adaptor
. It accommodates newcuco::allocator
APIs that don't take stream as input argument.