-
Notifications
You must be signed in to change notification settings - Fork 923
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
JNI: Rewrite growBuffersAndRows to accelerate the HostColumnBuilder (#…
…10025) According to NVIDIA/spark-rapids#4393, current PR takes several measures to speed up the buffer growing during the build of `HostColumnVector`: 1. Introduce `rowCapacity` to cache the maximum number of rows/bytes 2. Introduce pura Java method `byteSizeOfNullMask` to get the size of the validity buffer 3. Reorganize the code structure to reduce the number of method calls I have tested this PR with the spark-rapids tests locally. BTW, shall we clean up the `HostColumnVector.Builder` and replace all the usages of `Builder` with `ColumnBuilder`? Authors: - Alfred Xu (https://github.com/sperlingxx) Approvers: - Robert (Bobby) Evans (https://github.com/revans2) URL: #10025
- Loading branch information
1 parent
6e500d1
commit b217d7e
Showing
11 changed files
with
650 additions
and
257 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.