-
Notifications
You must be signed in to change notification settings - Fork 240
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Revert "Disable orc write by default because of https://issues.apache.org/jira/browse/ORC-1075 (#4471)" #4535
Conversation
….org/jira/browse/ORC-1075 (NVIDIA#4471)" This reverts commit 8773141. Signed-off-by: Bobby Wang <[email protected]>
build |
converted to draft since cudf pr still draft |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@wbo4958 please elaborate a bit in the PR description why we're able to revert the disable commit because of the cudf changes, as this would help anyone that needs to investigate this change in the future.
@@ -1,5 +1,5 @@ | |||
/* | |||
* Copyright (c) 2020-2022, NVIDIA CORPORATION. | |||
* Copyright (c) 2020-2021, NVIDIA CORPORATION. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should leave 2022 in there I think
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done, Thx
build |
build |
Depends on rapidsai/cudf#10041 which has added the column statistic in RowIndex when writing ORC files by CUDF. I tested it locally, it can work. We need to enable GPU accelerated ORC write by default.