Code

Expose pack/unpack API to Python#8153

Code

Merged

rapids-bot[bot] merged 44 commits intorapidsai:branch-21.08rapidsai/cudf:branch-21.08from charlesbluca:expose-pack-apicharlesbluca/cudf:expose-pack-apiCopy head branch name to clipboardJun 30, 2021

+516-3

Commits

Commits on May 4, 2021

• Expose pack/unpack API

  charlesbluca

  committed
  21e2e53

  Copy full SHA for 21e2e53

• Package resorting

  charlesbluca

  committed
  49440ed

  Copy full SHA for 49440ed

• Rename pack/unpack function

  charlesbluca

  committed
  06d82bc

  Copy full SHA for 06d82bc

Commits on May 5, 2021

• Add basic Cython function testing

  charlesbluca

  committed
  2d826c4

  Copy full SHA for 2d826c4

• Split pack/unpack into individual functions

  charlesbluca

  committed
  f2ed139

  Copy full SHA for f2ed139

• Remove unnecessary cudf import

  charlesbluca

  committed
  878de88

  Copy full SHA for 878de88

Commits on May 6, 2021

• Additional tests for unpacked dataframes

  charlesbluca

  committed
  77dc379

  Copy full SHA for 77dc379

Commits on May 7, 2021

• Add packed columns Python wrapper class

  charlesbluca

  committed
  bc3228d

  Copy full SHA for bc3228d

Commits on May 10, 2021

• Merge remote-tracking branch 'upstream/branch-0.20' into expose-pack-api

  charlesbluca

  committed
  82e0682

  Copy full SHA for 82e0682

• Replace Cython tests with Python

  charlesbluca

  committed
  e5e8e8e

  Copy full SHA for e5e8e8e

• Remove unnecessary import

  charlesbluca

  committed
  c9094a3

  Copy full SHA for c9094a3

• Run pre-commit hooks

  charlesbluca

  committed
  55da00b

  Copy full SHA for 55da00b

Commits on May 13, 2021

• First pass at serialization

  charlesbluca

  committed
  da27ce8

  Copy full SHA for da27ce8

Commits on May 14, 2021

• Make unique_ptr of metadata instead

  charlesbluca

  committed
  7bfad47

  Copy full SHA for 7bfad47

Commits on May 17, 2021

• Fix segfaults in pickling/unpickling

  charlesbluca

  committed
  d1ae22d

  Copy full SHA for d1ae22d

Commits on May 19, 2021

• Merge remote-tracking branch 'upstream/branch-21.06' into expose-pack-api

  charlesbluca

  committed
  82b31dd

  Copy full SHA for 82b31dd

Commits on May 20, 2021

• Add support for pickle-style serialization

  charlesbluca

  committed
  6d4d275

  Copy full SHA for 6d4d275

• Expand tests for pack/unpack

  charlesbluca

  committed
  6bed65d

  Copy full SHA for 6bed65d

• Remove potential circular import risk

  charlesbluca

  committed
  d57893b

  Copy full SHA for d57893b

• Add logic to pack to decide whether to keep index

  charlesbluca

  committed
  674d259

  Copy full SHA for 674d259

• Check for column data before asserting pointer inequality

  charlesbluca

  committed
  681a78a

  Copy full SHA for 681a78a

Commits on May 21, 2021

• Add pack tests for list and struct columns

  charlesbluca

  committed
  f689d63

  Copy full SHA for f689d63

Commits on May 24, 2021

• Clarify that input table is Python object

  charlesbluca

  committed
  0a64054

  Copy full SHA for 0a64054

• Flesh out docstrings a bit

  charlesbluca

  committed
  9b55484

  Copy full SHA for 9b55484

• Add return types

  charlesbluca

  committed
  a826093

  Copy full SHA for a826093

Commits on May 26, 2021

• Function renames

  charlesbluca

  committed
  8f22d76

  Copy full SHA for 8f22d76

• Return a Table from Python unpack

  charlesbluca

  committed
  aa54fbf

  Copy full SHA for aa54fbf

• Naive addition of dtypes w.r.t. serialization

  charlesbluca

  committed
  1c5b163

  Copy full SHA for 1c5b163

• Remove debugging block

  charlesbluca

  committed
  683ad13

  Copy full SHA for 683ad13

Commits on May 27, 2021

• Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack-api

  charlesbluca

  committed
  e7be8f0

  Copy full SHA for e7be8f0

• Call DataFrame _from_table for tests

  charlesbluca

  committed
  656f5de

  Copy full SHA for 656f5de

Commits on Jun 14, 2021

• Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack-api

  charlesbluca

  committed
  b413362

  Copy full SHA for b413362

Commits on Jun 15, 2021

• Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack-api

  charlesbluca

  committed
  a749d19

  Copy full SHA for a749d19

• Use metadata apply in pack/unpack

  charlesbluca

  committed
  d33fe8a

  Copy full SHA for d33fe8a

• Fix categorical test

  charlesbluca

  committed
  e99b267

  Copy full SHA for e99b267

Commits on Jun 21, 2021

• Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack-api

  charlesbluca

  committed
  fd6ce46

  Copy full SHA for fd6ce46

• Serialize dtypes of packed columns

  charlesbluca

  committed
  b49a4ab

  Copy full SHA for b49a4ab

• Add additional serialization tests

  charlesbluca

  committed
  f279710

  Copy full SHA for f279710

• Some docstring alterations

  charlesbluca

  committed
  f2af602

  Copy full SHA for f2af602

Commits on Jun 22, 2021

• Move pickle to top level imports

  charlesbluca

  committed
  b78d6f9

  Copy full SHA for b78d6f9

• Wrap Cython packed columns in serializable Python class

  charlesbluca

  committed
  4dbd87f

  Copy full SHA for 4dbd87f

• Add serialization roundtrip tests, centralize in test_pack.py

  charlesbluca

  committed
  4ece337

  Copy full SHA for 4ece337

Commits on Jun 30, 2021

• Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack-api

  charlesbluca

  committed
  af6e8e4

  Copy full SHA for af6e8e4

• Fix assert_eq import

  charlesbluca

  committed
  3fa48c1

  Copy full SHA for 3fa48c1