Code

Add new dask_cudf.read_parquet API#17250

Code

Merged

rapids-bot[bot] merged 28 commits intorapidsai:branch-24.12rapidsai/cudf:branch-24.12from rjzamora:new-read-parquet-apirjzamora/cudf:new-read-parquet-apiCopy head branch name to clipboardNov 20, 2024

+784-193

Commits

Commits on Nov 5, 2024

• add new read_parquet API to dask_cudf

  rjzamora

  committed
  3e853f8

• fix non-expr deprecation

  rjzamora

  committed
  b30c529

Commits on Nov 6, 2024

• fix CudfReadParquetFSSpec fusion

  rjzamora

  committed
  e3c640a

• correct for aggregate_files=False

  rjzamora

  committed
  e482026

• Merge remote-tracking branch 'upstream/branch-24.12' into new-read-parquet-api

  rjzamora

  committed
  b9af7b7

• update default blocksize, and add docstring

  rjzamora

  committed
  2ad1867

• Merge branch 'branch-24.12' into new-read-parquet-api

  rjzamora

  authored
  6c37a9c

Commits on Nov 7, 2024

• Merge branch 'branch-24.12' into new-read-parquet-api

  rjzamora

  authored
  53dfbdf

Commits on Nov 12, 2024

• Merge remote-tracking branch 'upstream/branch-24.12' into new-read-parquet-api

  rjzamora

  committed
  900ebf6

• revise _normalize_blocksize

  rjzamora

  committed
  3fb23fd

Commits on Nov 13, 2024

• Merge remote-tracking branch 'upstream/branch-24.12' into new-read-parquet-api

  rjzamora

  committed
  7af233e

• fix test

  rjzamora

  committed
  0552b33

• proper test fix - and disable dataset processing unless necessary

  rjzamora

  committed
  564c13c

• preserve default hive handling in cudf

  rjzamora

  committed
  64dd105

• Merge remote-tracking branch 'upstream/branch-24.12' into new-read-parquet-api

  rjzamora

  committed
  68b8faf

Commits on Nov 14, 2024

• Merge branch 'branch-24.12' into new-read-parquet-api

  rjzamora

  authored
  e074004

Commits on Nov 15, 2024

• Merge branch 'branch-24.12' into new-read-parquet-api

  vyasr

  authored
  a305398

Commits on Nov 18, 2024

• Merge remote-tracking branch 'upstream/branch-24.12' into new-read-parquet-api

  rjzamora

  committed
  b539ed4

• address code review

  rjzamora

  committed
  0291b95

• Merge remote-tracking branch 'upstream/branch-24.12' into new-read-parquet-api

  rjzamora

  committed
  beafffb

• sample single worker for device size

  rjzamora

  committed
  0832e55

• Merge remote-tracking branch 'upstream/branch-24.12' into new-read-parquet-api

  rjzamora

  committed
  db82e0b

Commits on Nov 19, 2024

• Merge branch 'branch-24.12' into new-read-parquet-api

  rjzamora

  authored
  df1e283

• use CUDA_VISIBLE_DEVICES

  rjzamora

  committed
  2195947

• Merge branch 'new-read-parquet-api' of github.com:rjzamora/cudf into new-read-parquet-api

  rjzamora

  committed
  1038170

• support mig

  rjzamora

  committed
  0ecf6dd

• Update python/dask_cudf/dask_cudf/io/parquet.py

  rjzamora

  authored
  fa03396

Commits on Nov 20, 2024

• Merge branch 'branch-24.12' into new-read-parquet-api

  madsbk

  authored
  1b79270