Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an event handler for ColumnVector.close #13279

Merged

Conversation

abellina
Copy link
Contributor

@abellina abellina commented May 2, 2023

This adds an event handler for ColumnVector to be invoked when .close() is invoked.

I also made getRefCount public since it is useful for debugging and I couldn't think of a good reason to keep this hidden.

This event handler is used to keep track of what columns are spillable at a time and is part of NVIDIA/spark-rapids#7672.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@abellina abellina requested a review from a team as a code owner May 2, 2023 22:03
@github-actions github-actions bot added the Java Affects Java cuDF API. label May 2, 2023
@abellina abellina added feature request New feature or request Spark Functionality that helps Spark RAPIDS non-breaking Non-breaking change labels May 2, 2023
@abellina
Copy link
Contributor Author

abellina commented May 3, 2023

/merge

Copy link
Contributor

@jbrennan333 jbrennan333 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@rapids-bot rapids-bot bot merged commit f6abfdd into rapidsai:branch-23.06 May 3, 2023
rapids-bot bot pushed a commit that referenced this pull request Aug 18, 2023
)

This change adds the exact same API for event handling that was added to the device-side `ColumnVector` here #13279. We are going to need this to make `HostColumnVector`, or a batch of them,  spillable in this spark-rapids feature: NVIDIA/spark-rapids#8882.

Authors:
  - Alessandro Bellina (https://github.com/abellina)

Approvers:
  - Gera Shegalov (https://github.com/gerashegalov)
  - Robert (Bobby) Evans (https://github.com/revans2)

URL: #13898
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request Java Affects Java cuDF API. non-breaking Non-breaking change Spark Functionality that helps Spark RAPIDS
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants