Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove unused functionality in cudf._lib.utils.pyx #17586

Merged
merged 1 commit into from
Dec 16, 2024

Conversation

mroeschke
Copy link
Contributor

Description

Contributes to #17317

More can be removed once my other cudf._lib PRs are in

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@mroeschke mroeschke added Python Affects Python cuDF API. improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Dec 12, 2024
@mroeschke mroeschke self-assigned this Dec 12, 2024
@mroeschke mroeschke requested a review from a team as a code owner December 12, 2024 23:22
@mroeschke mroeschke requested review from vyasr and bdice December 12, 2024 23:22
Copy link
Contributor

@vyasr vyasr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cwharris are any of the functions being removed here ones that you currently rely on in Morpheus?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If everything left is for pylibcudf interop, there may be a more descriptive name than “utils.” Feel free to punt on this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. I think, if anything, the remaining used functions will be moved to cudf/utils/ioutils.py so I'll punt on the intermediate rename

@dagardner-nv
Copy link
Contributor

In Morpheus we use the following which are being removed that we will need an alternative for:

  • data_from_unique_ptr
    We use this to construct a cudf.DataFrame from a cudf::io::table_with_metadata. Our current useage looks like:
data, index = data_from_unique_ptr(move(table.tbl), column_names=column_names, index_names=index_names)
df = cudf.DataFrame._from_data(data, index)
  • table_view_from_table
    We use this when our C++ code receives a Python cudf.DataFrame object to get a libcudf cudf::table_view object which we can then use to read table/column data with.

@mroeschke
Copy link
Contributor Author

Will not merge until nv-morpheus/Morpheus#2082 is in

rapids-bot bot pushed a commit to nv-morpheus/Morpheus that referenced this pull request Dec 16, 2024
In anticipation of this downstream cuDF PR removing some functionality in `cudf._lib.utils` rapidsai/cudf#17586, this PR replaces that usage with equivalent usage from the stable `pylibcudf`

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md).
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Matthew Roeschke (https://github.com/mroeschke)
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - David Gardner (https://github.com/dagardner-nv)

URL: #2082
@mroeschke
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit 469f226 into rapidsai:branch-25.02 Dec 16, 2024
108 checks passed
@mroeschke mroeschke deleted the cln/_lib/utils branch December 16, 2024 19:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Python Affects Python cuDF API.
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

4 participants