Code

Join APIs that return gathermaps#7454

Code

Merged

rapids-bot[bot] merged 183 commits intorapidsai:branch-0.19rapidsai/cudf:branch-0.19from shwina:gathermap-based-join-apisshwina/cudf:gathermap-based-join-apisCopy head branch name to clipboardMar 30, 2021

+1,998-3,070

Commits

Commits on Dec 11, 2020

• Merge branch 'branch-0.17' into branch-0.18

  shwina

  committed
  4a4b4af

Commits on Dec 15, 2020

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into branch-0.18

  shwina

  committed
  223f2b5

Commits on Dec 17, 2020

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into branch-0.18

  shwina

  committed
  abd6ad2

Commits on Jan 4, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into branch-0.18

  shwina

  committed
  18863b5

Commits on Jan 5, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into branch-0.18

  shwina

  committed
  0fbdd31

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into branch-0.18

  shwina

  committed
  dc9b943

Commits on Jan 7, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into branch-0.18

  shwina

  committed
  d586aa7

Commits on Jan 8, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into branch-0.18

  shwina

  committed
  996fda8

Commits on Jan 11, 2021

• Add a compute_hash_join_indices that returns just the join indices

  shwina

  committed
  2808a5c

• Don't need common_columns stuff for join that returns a gathermap

  shwina

  committed
  ef0baee

• Add hash_join_impl methods that return gathermaps

  shwina

  committed
  18f3074

• Add overloads to public hash_join class

  shwina

  committed
  70abf48

• Add top-level join APIs that return gathermaps

  shwina

  committed
  13dff67

Commits on Jan 12, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  3300fe1

• Use device_uvector instead of device_vector in join

  shwina

  committed
  7ed694c

• Undo some API changes

  shwina

  committed
  636c2ea

Commits on Jan 13, 2021

• Add join_result

  shwina

  committed
  b79da68

• Add APIs that return join_result

  shwina

  committed
  380aa59

• Remove column_in_common

  shwina

  committed
  3cbb2b4

Commits on Jan 14, 2021

• Add an inner join API that returns gathermaps

  shwina

  committed
  53ae7c9

• Add remaining APIs to return gathermaps

  shwina

  committed
  fde172b

Commits on Jan 18, 2021

• Add gathermap join test

  shwina

  committed
  4a286dd

• Replace -1 with INT_MIN

  shwina

  committed
  c756db9

Commits on Jan 20, 2021

• Make join_result columns instead of column_views

  shwina

  committed
  6a3d23e

• Replace join_result with a pair of columns

  shwina

  committed
  5dfc2a0

• Add gathermap test for outer join

  shwina

  committed
  362829b

• Add and pass full join gathermap test

  shwina

  committed
  4e4380c

Commits on Jan 21, 2021

• Begin Python-side refactor

  shwina

  committed
  339a13d

Commits on Jan 25, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  2b07802

Commits on Jan 28, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  0d5a19c

Commits on Feb 1, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  fdbdc12

Commits on Feb 5, 2021

• Merge branch 'branch-0.18' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  5dd5d29

Commits on Feb 8, 2021

• Merge branch 'branch-0.19' into gathermap-based-join-apis

  shwina

  committed
  6b20429

• Add left_semi and left_anti join APIs that return gathermaps

  shwina

  committed
  044eac1

• Add Cython bindings

  shwina

  committed
  555d5ec

Commits on Feb 9, 2021

• full -> outer

  shwina

  committed
  56ae616

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  dd05121

• Progress

  shwina

  committed
  d447924

• More progress on py refactor

  shwina

  committed
  484512e

Commits on Feb 10, 2021

• Remove breakpoint

  shwina

  committed
  5227582

• Fix neg index handling

  shwina

  committed
  9cd870e

• Use nullify gather in join

  shwina

  committed
  8e4f193

• Handle outer joins better

  shwina

  committed
  29fe140

• Fix index construction

  shwina

  committed
  b634055

• Fix sorting behaviour

  shwina

  committed
  cd53d6c

• Fix Index.join

  shwina

  committed
  75f1efd

• Progress on semi/anti joins

  shwina

  committed
  1f5d6ad

• Add simple join test

  shwina

  committed
  de30520

Commits on Feb 11, 2021

• Semi-join fix

  shwina

  committed
  66a0de5

• Only combine key columns in outer join if they have the same name

  shwina

  committed
  ca72295

• Handle when both _on and _index are provided

  shwina

  committed
  ee2242d

• Fix sorting join result

  shwina

  committed
  e531725

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  c8b4948

Commits on Feb 12, 2021

• whitespace

  shwina

  committed
  674095c

• Make construct_join_output_df work with column views

  shwina

  committed
  cbd9dc3

• Get rid of hash_join::left_join

  shwina

  committed
  3f3c3cb

• More join C++ cleanup

  shwina

  committed
  01415fc

Commits on Feb 17, 2021

• Even more cleaning

  shwina

  committed
  6185492

Commits on Feb 18, 2021

• More join tests

  shwina

  committed
  d736d1c

• Fix all join tests

  shwina

  committed
  b58591d

• Python regressions

  shwina

  committed
  be560bb

• Revert

  shwina

  committed
  efb60d6

• Invalid -> Unkown

  shwina

  committed
  fe6d0b8

• Don't mutate lhs/rhs

  shwina

  committed
  547027c

Commits on Feb 19, 2021

• Fix join tests

  shwina

  committed
  5f93d23

• Fix semi/anti join trivial cases

  shwina

  committed
  b7bf821

• When testing join results, use a helper that sorts values

  shwina

  committed
  50a2fb2

• Totally broken commit

  shwina

  committed
  ff0ae79

Commits on Feb 20, 2021

• Cleanup

  shwina

  committed
  07cd052

• Warnings

  shwina

  committed
  bd6bf77

Commits on Feb 22, 2021

• Cleanup

  shwina

  committed
  a40063e

• Cleanup

  shwina

  committed
  ccef9d0

• Cleanup

  shwina

  committed
  210244b

• Add typing for join helpers

  shwina

  committed
  b57348c

• Typing for Join class

  shwina

  committed
  5c2c9b3

• Simplify joiner API

  shwina

  committed
  558aa15

• Example doc

  shwina

  committed
  3184896

Commits on Feb 25, 2021

• Refactor join APIs to return a device_uvector

  shwina

  committed
  d3535dc

Commits on Mar 1, 2021

• Merge tag 'branch-0.19-latest' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  3b0a2a5

Commits on Mar 3, 2021

• docs

  shwina

  committed
  b82181d

• Finish up docs?

  shwina

  committed
  77d2bfd

Commits on Mar 4, 2021

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  0bf34e8

• Fix join tests

  shwina

  committed
  26a3fb0

Commits on Mar 5, 2021

• Refactor join APIs to work with unique_ptr<rmm::device_uvector>>

  shwina

  committed
  8a60d62

• Update join Cython

  shwina

  committed
  387a953

• Need to resize the gathermap

  shwina

  committed
  6cd6433

• Doc

  shwina

  committed
  c67dcce

• Changelog

  shwina

  committed
  30c22ed

Commits on Mar 9, 2021

• Add helper to convert gather_map_type->Column

  shwina

  committed
  f73199d

• Update python/cudf/cudf/core/frame.py

  Show description for 393c06a
  

  shwina

  and

  brandon-b-miller

  authored
  393c06a

• Cannot specify both column and index

  shwina

  committed
  e91f554

• Vaildate how

  shwina

  committed
  0185896

• Merge branch 'gathermap-based-join-apis' of github.com:shwina/cudf into gathermap-based-join-apis

  shwina

  committed
  b232f85

• Can't use a set

  shwina

  committed
  1eb495d

Commits on Mar 10, 2021

• Avoid function local import

  shwina

  committed
  4f1f072

• False -> NotImplementedError

  shwina

  committed
  4aa8fec

• Update cpp/include/cudf/join.hpp

  Show description for ae0e5f9
  

  shwina

  and

  jrhemstad

  authored
  ae0e5f9

• Reuse some join logic

  shwina

  committed
  f47cf7e

• Merge branch 'gathermap-based-join-apis' of github.com:shwina/cudf into gathermap-based-join-apis

  shwina

  committed
  2a201c3

• Formatting

  shwina

  committed
  230ca08

Commits on Mar 11, 2021

• Update cpp/include/cudf/join.hpp

  Show description for 498a621
  

  shwina

  and

  jrhemstad

  authored
  498a621

• Docs?

  shwina

  committed
  2de26f3

• Merge branch 'gathermap-based-join-apis' of github.com:shwina/cudf into gathermap-based-join-apis

  shwina

  committed
  d6f128c

• Use mr

  shwina

  committed
  b7d8d8a

Commits on Mar 15, 2021

• Docs

  shwina

  committed
  9efc761

Commits on Mar 16, 2021

• Simplify suffix handling

  shwina

  committed
  8779bc7

Commits on Mar 17, 2021

• Simplify joiner requirements

  shwina

  committed
  4c651ac

• Do less work in SemiJoin._merge_results

  shwina

  committed
  b4f4d7c

• Doc

  shwina

  committed
  d353c92

• Doc

  shwina

  committed
  580a346

• Return None from semi_join

  shwina

  committed
  328dafd

• Init common_type

  shwina

  committed
  297d20a

Commits on Mar 18, 2021

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  e388dd6

Commits on Mar 19, 2021

• Move validation directly into set_by_label and use a raw dict to store the columns in the accessor.

  vyasr

  committed
  935648b

• Remove all references to OrderedColumnDict.

  vyasr

  committed
  806a3ef

• Move validation to separate method and use in both set_by_label and constructor.

  vyasr

  committed
  40a7b17

• Format with black.

  vyasr

  committed
  a1c576e

• Expose parameter to make validation optional.

  vyasr

  committed
  788d9d6

• Coerce constructor input to dict before calling items.

  vyasr

  committed
  6a64285

• Make construction safe.

  vyasr

  committed
  e7d0981

• Final cleanup and documentation.

  vyasr

  committed
  c39932c

• Address style issues.

  vyasr

  committed
  4ff09fc

Commits on Mar 22, 2021

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  35c63ec

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into feature/optimize_accessor_copy

  shwina

  committed
  9433582

• Merge remote-tracking branch 'origin/branch-0.19' into feature/optimize_accessor_copy

  vyasr

  committed
  74f2884

• CA fix

  shwina

  committed
  0178127

• Merge branch 'feature/optimize_accessor_copy' into join-bench

  shwina

  committed
  5c0f202

• Don't validate on gathers

  shwina

  committed
  c8d2364

• Prioritize numeric columns

  shwina

  committed
  efea63d

• Merge branch 'feature/optimize_accessor_copy' into join-bench

  shwina

  committed
  898a3d8

• Lazily compute and delete column length on demand.

  vyasr

  committed
  c3b6444

• Remove redundant clear cache in setitem.

  vyasr

  committed
  01b2cf5

• Remove mypy annotation for column length.

  vyasr

  committed
  8899258

• Optimize casting logic

  shwina

  committed
  c6cd415

• Merge branch 'feature/optimize_accessor_copy' of github.com:vyasr/cudf into feature/optimize_accessor_copy

  shwina

  committed
  3507785

• Undo

  shwina

  committed
  7f8e1cd

• Don't validate when copying type metadata

  shwina

  committed
  f2e4609

• Merge branch 'feature/optimize_accessor_copy' into join-bench

  shwina

  committed
  5d378c2

• ImportError

  shwina

  committed
  83cc407

• Prioritize numeric dtypes in is_numerical_dtype

  shwina

  committed
  72598fb

• Add unsafe CA ctor

  shwina

  committed
  fa220b6

• Merge branch 'feature/optimize_accessor_copy' into join-bench

  shwina

  committed
  6572cd3

• Revert "Prioritize numeric dtypes in is_numerical_dtype"

  Show description for f7dc417
  shwina

  committed
  f7dc417

• Revert "Prioritize numeric dtypes in is_numerical_dtype"

  Show description for 3760077
  shwina

  committed
  3760077

• Merge branch 'feature/optimize_accessor_copy' into join-bench

  shwina

  committed
  01cdfcf

Commits on Mar 23, 2021

• Change error message back so that tests pass.

  vyasr

  committed
  de9ca28

• Faster is_numerical_dtype

  shwina

  committed
  e35d03b

• Faster is_numerical_dtype

  shwina

  committed
  e2fd533

• Merge branch 'feature/optimize_accessor_copy' into join-bench

  shwina

  committed
  9044d62

• Even faster is_numerical_dtype

  shwina

  committed
  64ca702

• Enable fast path for constructing a Buffer from a DeviceBuffer

  shwina

  committed
  749edf1

• Merge branch 'feature/optimize_accessor_copy' into join-bench

  shwina

  committed
  7526e4a

• Small fix

  shwina

  committed
  ca772b8

• Add validation option to insert and standardize error message.

  vyasr

  committed
  739ec57

• Fix style.

  vyasr

  committed
  498b70e

• Merge remote-tracking branch 'vyasr/feature/optimize_accessor_copy' into various-py-optimizations

  shwina

  committed
  3cd012b

• Merge branch 'various-py-optimizations' into join-bench

  shwina

  committed
  660afa6

• Merge branch 'gathermap-based-join-apis' into join-bench

  shwina

  committed
  f8ac22f

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into various-py-optimizations

  shwina

  committed
  c28866c

• Undo formatting change

  shwina

  committed
  01e13fa

• Add TODO

  shwina

  committed
  89a0301

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  26f4cc8

• Merge branch 'various-py-optimizations' into join-bench

  shwina

  committed
  f2036eb

Commits on Mar 24, 2021

• init->create + doc

  shwina

  committed
  5e73de7

• Merge branch 'various-py-optimizations' into gathermap-based-join-apis

  shwina

  committed
  e0c50b5

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  fa880c1

Commits on Mar 25, 2021

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  58bdecd

• Merge branch 'join-bench' into gathermap-based-join-apis

  shwina

  committed
  ed1b434

• Only gather the index if necessary

  shwina

  committed
  ca116a3

• Don't copy type metadata for the index unless we need to

  shwina

  committed
  ce03918

• Use validate=False in a few more places

  shwina

  committed
  b7c6b19

Commits on Mar 26, 2021

• Import

  shwina

  committed
  671a0e0

• Review

  shwina

  committed
  797087b

• Coerce to tuple first

  shwina

  committed
  5ad531f

• Replace hasattr with isinstance

  shwina

  committed
  f7e94fb

• Handle renamed indexes

  shwina

  committed
  1cb9448

• Fix to names setter

  shwina

  committed
  cc89360

• Merge branch 'branch-0.19' of https://github.com/rapidsai/cudf into gathermap-based-join-apis

  shwina

  committed
  4ca1238

• Update cpp/src/join/hash_join.cu

  Show description for 9cebf2e
  

  shwina

  and

  harrism

  authored
  9cebf2e

• Better example

  shwina

  committed
  1584b86

• Remove std::moves

  shwina

  committed
  3977b79

• Merge branch 'gathermap-based-join-apis' of github.com:shwina/cudf into gathermap-based-join-apis

  shwina

  committed
  67919a3

• Fix formatting error

  shwina

  committed
  7bf6561