Code

Implement chunked ORC reader#10723

Code

Merged

ttnghia merged 16 commits intoNVIDIA:branch-24.06NVIDIA/spark-rapids:branch-24.06from ttnghia:chunked_orc_readerttnghia/spark-rapids:chunked_orc_readerCopy head branch name to clipboardMay 16, 2024

+307-141

Commits

Commits on Apr 16, 2024

• Refactor Parquet reader

  Show description for bc3003f
  ttnghia

  committed
  bc3003f

  Copy full SHA for bc3003f

• WIP for ORC chunked reader

  ttnghia

  committed
  df5b42b

  Copy full SHA for df5b42b

• Merge branch 'branch-24.06' into refactor_parquet_reader

  ttnghia

  committed
  563099e

  Copy full SHA for 563099e

• Update config

  ttnghia

  committed
  bbd63bd

  Copy full SHA for bbd63bd

• Add back the deprecated config

  Show description for 8053382
  ttnghia

  committed
  8053382

  Copy full SHA for 8053382

• Fix config

  Show description for ff46bef
  ttnghia

  committed
  ff46bef

  Copy full SHA for ff46bef

• Change message for the deprecated config

  Show description for 813b4c8
  ttnghia

  committed
  813b4c8

  Copy full SHA for 813b4c8

• Merge branch 'refactor_parquet_reader' into chunked_orc_reader

  ttnghia

  committed
  9852fba

  Copy full SHA for 9852fba

Commits on Apr 17, 2024

• Add OrcChunkedReader

  Show description for 03bc9a7
  ttnghia

  committed
  03bc9a7

  Copy full SHA for 03bc9a7

• Cleanup

  Show description for 8d59208
  ttnghia

  committed
  8d59208

  Copy full SHA for 8d59208

Commits on Apr 18, 2024

• Fix MultiFileCloudOrcPartitionReader

  Show description for f0a68ef
  ttnghia

  committed
  f0a68ef

  Copy full SHA for f0a68ef

• Fix readBufferToTablesAndClose

  Show description for d1b71ad
  ttnghia

  committed
  d1b71ad

  Copy full SHA for d1b71ad

Commits on Apr 22, 2024

• Fix comment

  Show description for 0e3f7c9
  ttnghia

  committed
  0e3f7c9

  Copy full SHA for 0e3f7c9

• Add chunked reader to tests

  Show description for 70ae900
  ttnghia

  committed
  70ae900

  Copy full SHA for 70ae900

• Fix table schema

  Show description for 67ec36f
  ttnghia

  committed
  67ec36f

  Copy full SHA for 67ec36f

Commits on Apr 23, 2024

• Merge branch 'branch-24.06' into chunked_orc_reader

  Show description for 5b858ec
  ttnghia

  committed
  5b858ec

  Copy full SHA for 5b858ec