-
Notifications
You must be signed in to change notification settings - Fork 915
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Workaround for CUB segmented-sort bug with boolean keys #12217
Workaround for CUB segmented-sort bug with boolean keys #12217
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for this workaround @davidwendt!
Codecov ReportBase: 88.25% // Head: 88.25% // No change to project coverage 👍
Additional details and impacted files@@ Coverage Diff @@
## branch-22.12 #12217 +/- ##
=============================================
Coverage 88.25% 88.25%
=============================================
Files 137 137
Lines 22571 22571
=============================================
Hits 19921 19921
Misses 2650 2650 Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. ☔ View full report at Codecov. |
Waiting on Spark to verify this change passes their tests. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, @davidwendt! Spark tests that were failing before this change are now passing.
Fix in CUB DeviceSegmentedSort allows for workaround to removed. The CUB fix is applied as a patch in the libcudf build process. Reference NVIDIA/cub#594 and #12217 Authors: - David Wendt (https://github.com/davidwendt) Approvers: - Elias Stehle (https://github.com/elstehle) - Robert Maynard (https://github.com/robertmaynard) URL: #12234
Description
Adds a workaround for
cudf::segmented_sort
when following the optimized path with a the key type ofbool
.Here, the optimized path is avoided by checking the column-type.
A gtest is also included for this case.
The workaround can be removed once NVIDIA/cub#594 is fixed and available for libcudf.
Closes #12201
Checklist