Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "Disable orc write by default because of https://issues.apache.org/jira/browse/ORC-1075 (#4471)" #4535

Merged
merged 2 commits into from
Jan 23, 2022

Conversation

wbo4958
Copy link
Collaborator

@wbo4958 wbo4958 commented Jan 14, 2022

Depends on rapidsai/cudf#10041 which has added the column statistic in RowIndex when writing ORC files by CUDF. I tested it locally, it can work. We need to enable GPU accelerated ORC write by default.

@wbo4958
Copy link
Collaborator Author

wbo4958 commented Jan 14, 2022

build

@tgravescs tgravescs marked this pull request as draft January 14, 2022 13:56
@tgravescs
Copy link
Collaborator

converted to draft since cudf pr still draft

@tgravescs tgravescs added the bug Something isn't working label Jan 14, 2022
@jlowe jlowe added the cudf_dependency An issue or PR with this label depends on a new feature in cudf label Jan 14, 2022
jlowe
jlowe previously approved these changes Jan 14, 2022
Copy link
Member

@jlowe jlowe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@wbo4958 please elaborate a bit in the PR description why we're able to revert the disable commit because of the cudf changes, as this would help anyone that needs to investigate this change in the future.

@wbo4958 wbo4958 marked this pull request as ready for review January 19, 2022 23:49
@@ -1,5 +1,5 @@
/*
* Copyright (c) 2020-2022, NVIDIA CORPORATION.
* Copyright (c) 2020-2021, NVIDIA CORPORATION.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should leave 2022 in there I think

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done, Thx

@wbo4958
Copy link
Collaborator Author

wbo4958 commented Jan 20, 2022

build

@wbo4958
Copy link
Collaborator Author

wbo4958 commented Jan 22, 2022

build

@wbo4958 wbo4958 merged commit 49bfde0 into NVIDIA:branch-22.02 Jan 23, 2022
@wbo4958 wbo4958 deleted the revert-orc-write branch January 23, 2022 02:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working cudf_dependency An issue or PR with this label depends on a new feature in cudf
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants