Code

[WIP] cuDF.dtype objects#6160

Code

Closed

brandon-b-miller wants to merge 82 commits intorapidsai:branch-0.16rapidsai/cudf:branch-0.16from brandon-b-miller:fea-introduce-cudf-dtypebrandon-b-miller/cudf:fea-introduce-cudf-dtypeCopy head branch name to clipboard

+2,327-810

Commits

Commits on Jul 28, 2020

• initial dtype work

  brandon-b-miller

  committed
  1c83eac

  Copy full SHA for 1c83eac

• begin to plumb dtype

  brandon-b-miller

  committed
  33bd96c

  Copy full SHA for 33bd96c

Commits on Jul 29, 2020

• migrate dtypes to cudf main __init__

  brandon-b-miller

  committed
  baf138c

  Copy full SHA for baf138c

• numerical column plumbing

  brandon-b-miller

  committed
  bdb87fa

  Copy full SHA for bdb87fa

• update dtype classes, mappings

  brandon-b-miller

  committed
  4a3fe71

  Copy full SHA for 4a3fe71

• start to plumb stringcolumn

  brandon-b-miller

  committed
  1cf2c3e

  Copy full SHA for 1cf2c3e

Commits on Jul 30, 2020

• inherit from basic cython class

  brandon-b-miller

  committed
  dbc4970

  Copy full SHA for dbc4970

• plumb numerical column __repr__, default_na_value

  brandon-b-miller

  committed
  ba42bd8

  Copy full SHA for ba42bd8

• plumb some parts of unary

  brandon-b-miller

  committed
  60272e2

  Copy full SHA for 60272e2

• make a factory and fix bugs

  brandon-b-miller

  committed
  c03be40

  Copy full SHA for c03be40

Commits on Jul 31, 2020

• more progress on columns, dtype object

  brandon-b-miller

  committed
  7f6cb36

  Copy full SHA for 7f6cb36

• forgot string O

  brandon-b-miller

  committed
  a81c368

  Copy full SHA for a81c368

• more progress

  brandon-b-miller

  committed
  572c39f

  Copy full SHA for 572c39f

Commits on Aug 3, 2020

• column tests pass

  brandon-b-miller

  committed
  4f6f316

  Copy full SHA for 4f6f316

• working up through test_array_func

  brandon-b-miller

  committed
  ee6ece5

  Copy full SHA for ee6ece5

Commits on Aug 4, 2020

• more tests pass

  brandon-b-miller

  committed
  62c5e17

  Copy full SHA for 62c5e17

Commits on Aug 19, 2020

• merge 0.15 and resolve conflicts

  brandon-b-miller

  committed
  139465f

  Copy full SHA for 139465f

Commits on Aug 21, 2020

• handle list dtype in _Dtype

  brandon-b-miller

  committed
  ef5b9cb

  Copy full SHA for ef5b9cb

• fix series syntax error

  brandon-b-miller

  committed
  9320755

  Copy full SHA for 9320755

• add timedelta dtypes

  brandon-b-miller

  committed
  dac2940

  Copy full SHA for dac2940

• fix some numericalcolumn bugs

  brandon-b-miller

  committed
  6eee9eb

  Copy full SHA for 6eee9eb

• fix index type mapping dicts

  brandon-b-miller

  committed
  1ace460

  Copy full SHA for 1ace460

Commits on Aug 24, 2020

• pass all binop tests

  brandon-b-miller

  committed
  df6426b

  Copy full SHA for df6426b

Commits on Aug 25, 2020

• more progress

  brandon-b-miller

  committed
  92d1a64

  Copy full SHA for 92d1a64

Commits on Aug 26, 2020

• all column tests pass

  brandon-b-miller

  committed
  59b3673

  Copy full SHA for 59b3673

• move more stuff to cudf.api.types

  brandon-b-miller

  committed
  297a31a

  Copy full SHA for 297a31a

• forgot entire api/ folder

  brandon-b-miller

  committed
  e5def6e

  Copy full SHA for e5def6e

• fix mutable_column_view

  brandon-b-miller

  committed
  b4d344f

  Copy full SHA for b4d344f

• working through dataframe.py tests

  brandon-b-miller

  committed
  22fd5d9

  Copy full SHA for 22fd5d9

Commits on Aug 27, 2020

• pass join tests

  brandon-b-miller

  committed
  c5a0b62

  Copy full SHA for c5a0b62

• fix categorical tests

  brandon-b-miller

  committed
  d47de03

  Copy full SHA for d47de03

• more bugfixes

  brandon-b-miller

  committed
  fe180a3

  Copy full SHA for fe180a3

Commits on Aug 28, 2020

• more progress

  brandon-b-miller

  committed
  cad48d0

  Copy full SHA for cad48d0

Commits on Aug 30, 2020

• all repr tests pass

  brandon-b-miller

  committed
  6a1785c

  Copy full SHA for 6a1785c

Commits on Aug 31, 2020

• all timedelta tests pass

  brandon-b-miller

  committed
  8552907

  Copy full SHA for 8552907

• sorting tests pass

  brandon-b-miller

  committed
  2b59285

  Copy full SHA for 2b59285

• fix more tests

  brandon-b-miller

  committed
  b2851a2

  Copy full SHA for b2851a2

Commits on Sep 1, 2020

• hackily pass select_dtype tests

  brandon-b-miller

  committed
  9540643

  Copy full SHA for 9540643

• all dataframe tests pass!

  brandon-b-miller

  committed
  781b42e

  Copy full SHA for 781b42e

Commits on Sep 2, 2020

• much more progress

  brandon-b-miller

  committed
  13fe291

  Copy full SHA for 13fe291

• fix indexing tests

  brandon-b-miller

  committed
  3c047ef

  Copy full SHA for 3c047ef

Commits on Sep 3, 2020

• less than 10 tests still failing

  brandon-b-miller

  committed
  a139571

  Copy full SHA for a139571

• merge 0.16 and resolve conflicts

  brandon-b-miller

  committed
  40a1699

  Copy full SHA for 40a1699

• fix bugs

  brandon-b-miller

  committed
  ea24184

  Copy full SHA for ea24184

• fix a few more bugs

  brandon-b-miller

  committed
  ddf340b

  Copy full SHA for ddf340b

• construct from string tests

  brandon-b-miller

  committed
  4a14042

  Copy full SHA for 4a14042

• clean up dtypes.py

  brandon-b-miller

  committed
  55cec7e

  Copy full SHA for 55cec7e

Commits on Sep 4, 2020

• fixed some bugs

  brandon-b-miller

  committed
  c28c7b6

  Copy full SHA for c28c7b6

• a little iteration on dtypes.py

  brandon-b-miller

  committed
  bad1dc2

  Copy full SHA for bad1dc2

• implement the scalar type attribute

  brandon-b-miller

  committed
  0938507

  Copy full SHA for 0938507

• cleanup and style

  brandon-b-miller

  committed
  e5a489d

  Copy full SHA for e5a489d

Commits on Sep 9, 2020

• bug fixes and type attribute plumbing/iteration

  brandon-b-miller

  committed
  62a7d5b

  Copy full SHA for 62a7d5b

• fix repr and move around testing utilities

  brandon-b-miller

  committed
  80baff4

  Copy full SHA for 80baff4

• clean up reduce.pyx

  brandon-b-miller

  committed
  38e11af

  Copy full SHA for 38e11af

• implement cudf::scalar -> cudf.Scalar -> Buffer, column

  brandon-b-miller

  committed
  22b299d

  Copy full SHA for 22b299d

Commits on Sep 10, 2020

• minor bugfixes

  brandon-b-miller

  committed
  1552c0a

  Copy full SHA for 1552c0a

• add __int__ and __float__ to scalar

  brandon-b-miller

  committed
  78caafa

  Copy full SHA for 78caafa

Commits on Sep 11, 2020

• partially implement scalar binops

  brandon-b-miller

  committed
  a9fe2fb

  Copy full SHA for a9fe2fb

• partial tests for scalar binop result dtype

  brandon-b-miller

  committed
  455af02

  Copy full SHA for 455af02

Commits on Sep 13, 2020

• scalar binop updates

  brandon-b-miller

  committed
  e4c0bf1

  Copy full SHA for e4c0bf1

Commits on Sep 14, 2020

• convert a list of cudf.Scalars into a contiguous column

  brandon-b-miller

  committed
  42828c0

  Copy full SHA for 42828c0

• migrate scalar methods to python

  brandon-b-miller

  committed
  0d3d6a0

  Copy full SHA for 0d3d6a0

• actually include scalar.py and update tests

  brandon-b-miller

  committed
  63e1387

  Copy full SHA for 63e1387

• fix the rest of test_reductions.py

  brandon-b-miller

  committed
  2005d65

  Copy full SHA for 2005d65

• fix indexing error

  brandon-b-miller

  committed
  523919c

  Copy full SHA for 523919c

• fix as_scalar

  brandon-b-miller

  committed
  c730301

  Copy full SHA for c730301

• remove unecessary code

  brandon-b-miller

  committed
  c5450c2

  Copy full SHA for c5450c2

• minor bugfixes

  brandon-b-miller

  committed
  7bc0893

  Copy full SHA for 7bc0893

Commits on Sep 15, 2020

• scalar plumbing, cudf.api.types additions, bug fixes

  brandon-b-miller

  committed
  a3a4893

  Copy full SHA for a3a4893

• add cudf.api.types.isscalar(element)

  brandon-b-miller

  committed
  6bf121c

  Copy full SHA for 6bf121c

• plumbing

  brandon-b-miller

  committed
  165f86c

  Copy full SHA for 165f86c

• scalars may __round__

  brandon-b-miller

  committed
  cec9528

  Copy full SHA for cec9528

Commits on Sep 16, 2020

• to_numpy -> numpy_dtype

  brandon-b-miller

  committed
  a8b380b

  Copy full SHA for a8b380b

• extra to_numpy -> numpy_dtype that were missed

  brandon-b-miller

  committed
  1dc151a

  Copy full SHA for 1dc151a

• add docstrings, respond to reviews

  brandon-b-miller

  committed
  46a9c2f

  Copy full SHA for 46a9c2f

Commits on Sep 17, 2020

• minor fixes and code removal

  brandon-b-miller

  committed
  81e6058

  Copy full SHA for 81e6058

• remove cudf_dtype_from_pydata_dtype

  brandon-b-miller

  committed
  d7930eb

  Copy full SHA for d7930eb

• update api calls for find_common_type to be numpy-like

  brandon-b-miller

  committed
  c290a15

  Copy full SHA for c290a15

• let pandas handle categorical edge cases

  brandon-b-miller

  committed
  e90e325

  Copy full SHA for e90e325

• fix categorical creation and casting throughout cudf

  brandon-b-miller

  committed
  3d8ca2f

  Copy full SHA for 3d8ca2f

• remove old code

  brandon-b-miller

  committed
  2653384

  Copy full SHA for 2653384

• continued bugfixes

  brandon-b-miller

  committed
  123784b

  Copy full SHA for 123784b