Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use dynamic nullate for join hasher and equality comparator #9902

Merged
merged 5 commits into from
Dec 17, 2021

Conversation

davidwendt
Copy link
Contributor

Follow on PR for this comment: #9623 (comment)

The join hasher and equality-comparator were previously hardcoded with has_nulls=true (and migrated to nullate::YES) to help minimize code size. The new nullate::DYNAMIC allows for runtime checking of nulls so this can now be used here instead.

@davidwendt davidwendt added 2 - In Progress Currently a work in progress libcudf Affects libcudf (C++/CUDA) code. improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Dec 14, 2021
@davidwendt davidwendt self-assigned this Dec 14, 2021
@jrhemstad
Copy link
Contributor

Any chance this actually improved performance for tables without nulls?

@davidwendt
Copy link
Contributor Author

davidwendt commented Dec 14, 2021

Any chance this actually improved performance for tables without nulls?

Sadly no. I ran JOIN_BENCH and saw no real changes in performance.

@codecov
Copy link

codecov bot commented Dec 15, 2021

Codecov Report

Merging #9902 (784e644) into branch-22.02 (967a333) will decrease coverage by 0.08%.
The diff coverage is n/a.

❗ Current head 784e644 differs from pull request most recent head 2bd7d24. Consider uploading reports for the commit 2bd7d24 to get more accurate results
Impacted file tree graph

@@               Coverage Diff                @@
##           branch-22.02    #9902      +/-   ##
================================================
- Coverage         10.49%   10.40%   -0.09%     
================================================
  Files               119      119              
  Lines             20305    20503     +198     
================================================
+ Hits               2130     2134       +4     
- Misses            18175    18369     +194     
Impacted Files Coverage Δ
python/dask_cudf/dask_cudf/sorting.py 92.30% <0.00%> (-0.61%) ⬇️
python/cudf/cudf/__init__.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/frame.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/index.py 0.00% <0.00%> (ø)
python/cudf/cudf/io/parquet.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/series.py 0.00% <0.00%> (ø)
python/cudf/cudf/utils/utils.py 0.00% <0.00%> (ø)
python/cudf/cudf/utils/dtypes.py 0.00% <0.00%> (ø)
python/cudf/cudf/utils/ioutils.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/dataframe.py 0.00% <0.00%> (ø)
... and 13 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0c3f735...2bd7d24. Read the comment docs.

@davidwendt davidwendt added 3 - Ready for Review Ready for review by team and removed 2 - In Progress Currently a work in progress labels Dec 15, 2021
@davidwendt davidwendt marked this pull request as ready for review December 15, 2021 13:11
@davidwendt davidwendt requested a review from a team as a code owner December 15, 2021 13:11
@davidwendt davidwendt requested review from devavret and vuule December 15, 2021 13:11
@davidwendt
Copy link
Contributor Author

@gpucibot merge

@rapids-bot rapids-bot bot merged commit e6c6991 into rapidsai:branch-22.02 Dec 17, 2021
@davidwendt davidwendt deleted the join-use-dynamic-nullate branch December 17, 2021 08:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team improvement Improvement / enhancement to an existing function libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants