Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor existing code to better align with pipelined changes. #12810

Closed
1 task done
Tracked by #12755
hyperbolic2346 opened this issue Feb 21, 2023 · 0 comments
Closed
1 task done
Tracked by #12755

Refactor existing code to better align with pipelined changes. #12810

hyperbolic2346 opened this issue Feb 21, 2023 · 0 comments
Assignees
@hyperbolic2346
Labels
2 - In Progress Currently a work in progress cuIO cuIO issue libcudf Affects libcudf (C++/CUDA) code.

Comments

@hyperbolic2346
Copy link
Contributor

hyperbolic2346 commented Feb 21, 2023 •
edited
Loading

Code must be refactored in read to support the pipelined read. This would include changes necessary to allow reading the file in parts to allow for the pipelining.

Tasks
Preview Give feedback
  1. Refactor parquet read code to put chunk creation and reading into a function. #12811
@hyperbolic2346 hyperbolic2346 mentioned this issue Feb 21, 2023
Closed
5 tasks
@GregoryKimball GregoryKimball added 2 - In Progress Currently a work in progress cuIO cuIO issue libcudf Affects libcudf (C++/CUDA) code. labels Apr 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hyperbolic2346 hyperbolic2346

Labels
2 - In Progress Currently a work in progress cuIO cuIO issue libcudf Affects libcudf (C++/CUDA) code.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hyperbolic2346 @GregoryKimball