Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add test for map column metadata handling in ORC writer #9852

Merged
merged 6 commits into from
Dec 17, 2021

Conversation

vuule
Copy link
Contributor

@vuule vuule commented Dec 7, 2021

Expands existing ORC test to cover the fix merged in #9782

Test now has struct column nested in a map column, so that the propagation of names of the leaf columns (struct column field names in ORC) can be tested. The test segfaults without the fix in #9782

@vuule vuule added tests Unit testing for project libcudf Affects libcudf (C++/CUDA) code. cuIO cuIO issue non-breaking Non-breaking change labels Dec 7, 2021
@vuule vuule self-assigned this Dec 7, 2021
@vuule vuule added the improvement Improvement / enhancement to an existing function label Dec 7, 2021
@vuule vuule requested a review from sperlingxx December 7, 2021 01:38
@codecov
Copy link

codecov bot commented Dec 7, 2021

Codecov Report

Merging #9852 (6b6e1c8) into branch-22.02 (967a333) will decrease coverage by 0.08%.
The diff coverage is n/a.

Impacted file tree graph

@@               Coverage Diff                @@
##           branch-22.02    #9852      +/-   ##
================================================
- Coverage         10.49%   10.40%   -0.09%     
================================================
  Files               119      119              
  Lines             20305    20503     +198     
================================================
+ Hits               2130     2134       +4     
- Misses            18175    18369     +194     
Impacted Files Coverage Δ
python/dask_cudf/dask_cudf/sorting.py 92.30% <0.00%> (-0.61%) ⬇️
python/cudf/cudf/__init__.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/frame.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/index.py 0.00% <0.00%> (ø)
python/cudf/cudf/io/parquet.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/series.py 0.00% <0.00%> (ø)
python/cudf/cudf/utils/utils.py 0.00% <0.00%> (ø)
python/cudf/cudf/utils/dtypes.py 0.00% <0.00%> (ø)
python/cudf/cudf/utils/ioutils.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/dataframe.py 0.00% <0.00%> (ø)
... and 14 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 19190b4...6b6e1c8. Read the comment docs.

@vuule vuule marked this pull request as ready for review December 7, 2021 17:09
@vuule vuule requested a review from a team as a code owner December 7, 2021 17:09
@vuule vuule requested review from trxcllnt and ttnghia December 7, 2021 17:09
cpp/tests/io/orc_test.cpp Outdated Show resolved Hide resolved
Copy link
Contributor

@ttnghia ttnghia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Look good, except some nit in coding style that can be rewritten to be cleaner/nicer.

@github-actions github-actions bot added the CMake CMake build issue label Dec 9, 2021
@@ -41,6 +42,22 @@ using column_wrapper =
typename std::conditional<std::is_same_v<T, cudf::string_view>,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, this is clever. Need to remember this one.

BUILD_EXPORT_SET cudf-exports INSTALL_EXPORT_SET cudf-exports PATCH_COMMAND patch
--reject-file=- -p1 -N < ${CUDF_SOURCE_DIR}/cmake/libcudacxx.patch || true
BUILD_EXPORT_SET cudf-exports
INSTALL_EXPORT_SET cudf-exports PATCH_COMMAND patch --reject-file=- -p1 -N <
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not familiar with the syntax used in cmake files. Should there be a \ at the end to indicate continuation?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No idea, this is a style fix when the checker version changed. Merged trunk so these changes are gone from the PR.

Copy link
Contributor

@mythrocks mythrocks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor nitpicks/questions.

@vuule vuule requested a review from a team as a code owner December 17, 2021 00:56
@github-actions github-actions bot removed the CMake CMake build issue label Dec 17, 2021
@vuule
Copy link
Contributor Author

vuule commented Dec 17, 2021

@gpucibot merge

@rapids-bot rapids-bot bot merged commit 428a1b3 into rapidsai:branch-22.02 Dec 17, 2021
@vuule vuule deleted the missing-orc-map-test branch December 17, 2021 07:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cuIO cuIO issue improvement Improvement / enhancement to an existing function libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change tests Unit testing for project
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants