Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet reader list microkernel #16538

Merged
merged 52 commits into from
Oct 29, 2024
Merged
Show file tree
Hide file tree
Changes from 50 commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
b5ec22e
work in progress
pmattione-nvidia Aug 12, 2024
2ca9618
Further work in list code
pmattione-nvidia Aug 16, 2024
4b5f91a
Tests working
pmattione-nvidia Aug 27, 2024
ead17b8
Revert page_decode changes
pmattione-nvidia Aug 28, 2024
cc32409
Merge branch 'branch-24.10' into parquet_list_kernel
pmattione-nvidia Aug 28, 2024
0dccec5
Add debugging
pmattione-nvidia Sep 5, 2024
e239e79
Tests working
pmattione-nvidia Sep 7, 2024
8f25453
Merge branch 'branch-24.10' into parquet_list_kernel
pmattione-nvidia Sep 7, 2024
24c9ab1
compile fixes
pmattione-nvidia Sep 9, 2024
342c2f4
No need to decode def levels if not nullable
pmattione-nvidia Sep 10, 2024
50bbc94
Manual block scan
pmattione-nvidia Sep 10, 2024
5390661
Optimize parquet reader block scans, simplify and consolidate non-nul…
pmattione-nvidia Sep 18, 2024
3ef7b0d
tweak syncing
pmattione-nvidia Sep 18, 2024
7882879
small tweaks
pmattione-nvidia Sep 18, 2024
8852839
Merge branch 'branch-24.10' into parquet_list_kernel
pmattione-nvidia Sep 18, 2024
e285fbf
Add skipping to rle_stream, use for lists (chunked reads)
pmattione-nvidia Sep 23, 2024
254f3e9
tweak scan interface for linked lists
pmattione-nvidia Sep 24, 2024
18d989c
Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize
pmattione-nvidia Sep 25, 2024
8ea1e0e
style fixes
pmattione-nvidia Sep 25, 2024
326b386
Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm…
pmattione-nvidia Sep 25, 2024
41cb982
Update cpp/src/io/parquet/decode_fixed.cu
pmattione-nvidia Sep 26, 2024
6e70554
Update cpp/src/io/parquet/decode_fixed.cu
pmattione-nvidia Sep 26, 2024
9ad4415
Update cpp/src/io/parquet/decode_fixed.cu
pmattione-nvidia Sep 26, 2024
3a1fc95
Unroll block-count loop
pmattione-nvidia Sep 26, 2024
0babf46
Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm…
pmattione-nvidia Sep 26, 2024
5ab9829
more style fixes
pmattione-nvidia Sep 26, 2024
310d50c
Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize
pmattione-nvidia Sep 27, 2024
4471022
Disable manual block scan for non-lists
pmattione-nvidia Oct 2, 2024
c0ed2cb
Update cpp/src/io/parquet/decode_fixed.cu
pmattione-nvidia Oct 4, 2024
c2139ef
Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm…
pmattione-nvidia Oct 4, 2024
b898cba
Style fixes
pmattione-nvidia Oct 4, 2024
b0ee9fc
renaming
pmattione-nvidia Oct 7, 2024
36d026e
Merge branch 'mukernels_fixedwidth_optimize' into parquet_list_kernel
pmattione-nvidia Oct 7, 2024
4b7d1df
minor tweaks
pmattione-nvidia Oct 7, 2024
b36b3b2
delete some debug printing
pmattione-nvidia Oct 7, 2024
5b15704
Remove more prints
pmattione-nvidia Oct 7, 2024
e84af82
cleanup
pmattione-nvidia Oct 8, 2024
f200748
cleanup comments
pmattione-nvidia Oct 8, 2024
3fc76ee
style changes
pmattione-nvidia Oct 8, 2024
8c58d2b
Merge branch 'rapidsai:branch-24.12' into parquet_list_kernel
pmattione-nvidia Oct 8, 2024
ae8e193
Merge branch 'parquet_list_kernel' of https://github.com/pmattione-nv…
pmattione-nvidia Oct 8, 2024
edc56bd
constify variables
pmattione-nvidia Oct 11, 2024
e51406c
revert cmakelists change
pmattione-nvidia Oct 11, 2024
0237e5c
Merge branch 'branch-24.12' into parquet_list_kernel
pmattione-nvidia Oct 11, 2024
07ffbf2
Update cpp/src/io/parquet/rle_stream.cuh
pmattione-nvidia Oct 18, 2024
32fe8b9
refactor rle_stream
pmattione-nvidia Oct 18, 2024
031ac6b
Use divide function
pmattione-nvidia Oct 23, 2024
a82ae40
Merge branch 'branch-24.12' into parquet_list_kernel
pmattione-nvidia Oct 23, 2024
534e67d
address comments
pmattione-nvidia Oct 25, 2024
45c00b8
Merge branch 'parquet_list_kernel' of https://github.com/pmattione-nv…
pmattione-nvidia Oct 25, 2024
a6adb0d
Change scan interface to pass in shared memory to avoid sync issues
pmattione-nvidia Oct 28, 2024
f4aedb9
switch to sharing memory between scans
pmattione-nvidia Oct 29, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading