Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[gpuCI] Forward-merge branch-23.02 to branch-23.04 [skip gpuci] #12591

Merged
merged 1 commit into from
Jan 23, 2023

Conversation

GPUtester
Copy link
Collaborator

Forward-merge triggered by push to branch-23.02 that creates a PR to keep branch-23.04 up-to-date. If this PR is unable to be immediately merged due to conflicts, it will remain open for the team to manually merge.

Fixes two issues:

- A very old issue where we were incorrectly setting the output nesting depth in the PageNestingInfo struct in some cases.  Previously, this was benign, but the chunked reader broke because of it.  I fixed this and did some variable renaming to make things more clear.

- Fixed an issue with an optimization that was added for the chunked reader:  We were incorrectly determining when we could early out for a given page during the preprocessing step.

There is an issue as far as generating a test for this PR.  The conditions under which the second bug occurs require that values from a given row span multiple pages.  I couldn't get the cudf writer to make this happen.  The alternative is to use a pre-created file and use the python tests, but the issue there is that we don't expose skip_rows/num_rows through that API.  So I have no good way of building a test.

This fix has been vetted against a known real-world failure case.

Fixes #12376

Authors:
  - https://github.com/nvdbaranec
  - Vukasin Milovanovic (https://github.com/vuule)

Approvers:
  - Vukasin Milovanovic (https://github.com/vuule)
  - Yunsong Wang (https://github.com/PointKernel)

URL: #12488
@GPUtester GPUtester requested a review from a team as a code owner January 23, 2023 16:46
@GPUtester GPUtester merged commit 136b24c into branch-23.04 Jan 23, 2023
@GPUtester
Copy link
Collaborator Author

SUCCESS - forward-merge complete.

@github-actions github-actions bot added the libcudf Affects libcudf (C++/CUDA) code. label Jan 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
libcudf Affects libcudf (C++/CUDA) code.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants