-
Notifications
You must be signed in to change notification settings - Fork 463
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[VL] Remove Arrow from gluten #1434
Labels
Comments
Support all the velox data type in native ColumnarToRow to avoid fallback to valilla spark ColumnarToRow which will convert velox to arrow and then convert arrow to row |
Shuffle velox to velox, remove Arrow IPC |
Temporarily use static velox pool to convert arrow to velox, after split velox to velox, this static pool is not needed |
This was referenced May 6, 2023
This was referenced Jun 30, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
ArrowWritableVector
to nativeColumnarToRow
, compute pid change from ArrowWritableVector to native ColumnarToRow and concat pid ArrowBatch with VeloxColumnarBatchCoalesceBatchesExec
or implement veloxCoalesceBatchesExec
The text was updated successfully, but these errors were encountered: