Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove restrictions in struct sort preventing calls to libcudf bounds #2092

Merged
merged 2 commits into from
Apr 21, 2021

Conversation

gerashegalov
Copy link
Collaborator

@gerashegalov gerashegalov commented Apr 7, 2021

Signed-off-by: Gera Shegalov [email protected]

Closes #1605. In #1883 we had to work around the lack of struct support for
upper/lower_bound API in libcudf. This PR depends on rapidsai/cudf#7865

@gerashegalov gerashegalov added the cudf_dependency An issue or PR with this label depends on a new feature in cudf label Apr 7, 2021
@gerashegalov
Copy link
Collaborator Author

works as expected after removing relevant xfails

SPARK_HOME=~/spark-3.1.1-bin-hadoop3.2 \
  integration_tests/run_pyspark_from_build.sh -k test_single_nested_orderby

========= 20 passed, 5383 deselected, 100 xfailed in 188.11s (0:03:08) =========

@sameerz
Copy link
Collaborator

sameerz commented Apr 8, 2021

Since rapidsai/cudf#7865 is targeting 0.20, this should target 0.6.

@gerashegalov gerashegalov marked this pull request as draft April 9, 2021 20:04
@gerashegalov gerashegalov changed the title Remove restrictions in struct sort preventing calls to libcudf bounds [WIP] Remove restrictions in struct sort preventing calls to libcudf bounds Apr 9, 2021
@gerashegalov gerashegalov changed the base branch from branch-0.5 to branch-0.6 April 20, 2021 23:48
@gerashegalov gerashegalov self-assigned this Apr 20, 2021
@gerashegalov gerashegalov marked this pull request as ready for review April 20, 2021 23:49
@gerashegalov gerashegalov changed the title [WIP] Remove restrictions in struct sort preventing calls to libcudf bounds Remove restrictions in struct sort preventing calls to libcudf bounds Apr 20, 2021
@gerashegalov
Copy link
Collaborator Author

build

@gerashegalov gerashegalov requested a review from revans2 April 21, 2021 02:04
@revans2 revans2 merged commit 0555e4b into NVIDIA:branch-0.6 Apr 21, 2021
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
@gerashegalov gerashegalov deleted the enableUpperLowerBounds branch November 16, 2022 07:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cudf_dependency An issue or PR with this label depends on a new feature in cudf
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] Support sorting on struct type keys
3 participants