-
Notifications
You must be signed in to change notification settings - Fork 928
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support nested types in lists::contains
#10548
Support nested types in lists::contains
#10548
Conversation
Signed-off-by: Nghia Truong <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Comments attached.
Signed-off-by: Nghia Truong <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A few more comments -- I think I will approve when these are addressed. There's a lot going on in this PR and I've tried my best to make sense of it, but there's a lot of "patterning" with complex lambdas, boolean template dispatches, etc. I am struggling to find better recommendations but I don't think I can concretely identify what I would prefer in those cases, if anything, at this time.
Signed-off-by: Nghia Truong <[email protected]>
Signed-off-by: Nghia Truong <[email protected]>
Signed-off-by: Nghia Truong <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One minor comment, otherwise LGTM.
cpp/tests/lists/contains_tests.cpp
Outdated
auto const lists = [] { | ||
auto offsets = indices_col{0, 4, 7, 10, 15, 18, 21, 24, 24, 28, 28}; | ||
// clang-format off | ||
auto data1 = tdata_col{0, 1, 2, 1, // |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Are the trailing //
necessary if clang-format is already turned off in this section? I'd remove the trailing //
.
Signed-off-by: Nghia Truong <[email protected]>
Rerun tests. |
@gpucibot merge |
On some systems, CUDA compiler may have an issue such that it will throw unused variables warnings into your face if you use `if constexpr` with an `else` branch. Such warnings were reported due to a recent merged PR (#10548). This PR rewrites the `else` branch of the `if constexpr` in `lists/contains.cu` into a second `if constexpr` statement with opposite condition to avoid the warnings. Authors: - Nghia Truong (https://github.com/ttnghia) Approvers: - David Wendt (https://github.com/davidwendt) - Bradley Dice (https://github.com/bdice) - Mark Harris (https://github.com/harrism) URL: #11581
This extends the
lists::contains
API to support nested types (lists + structs) with arbitrarily nested levels. As such,lists::contains
will work with literally any type of input data.In addition, the related implementation has been significantly refactored to facilitate adding new implementation.
Closes #8958.
Depends on:
iterator.cuh
and add fixed point support forscalar_optional_accessor
#10999lists::contains
#11019left_semi_anti_join
,cudf::contains
, and set operations #11037