Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate cudf::io::merge_row_group_metadata to pylibcudf #17491

Merged
merged 6 commits into from
Dec 4, 2024

Conversation

Matt711
Copy link
Contributor

@Matt711 Matt711 commented Dec 3, 2024

Description

Apart of #15162

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

Copy link

copy-pr-bot bot commented Dec 3, 2024

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@Matt711 Matt711 marked this pull request as ready for review December 3, 2024 15:29
@Matt711 Matt711 requested a review from a team as a code owner December 3, 2024 15:29
@github-actions github-actions bot added Python Affects Python cuDF API. pylibcudf Issues specific to the pylibcudf package labels Dec 3, 2024
@Matt711 Matt711 added feature request New feature or request non-breaking Non-breaking change and removed Python Affects Python cuDF API. pylibcudf Issues specific to the pylibcudf package labels Dec 3, 2024
@github-actions github-actions bot added Python Affects Python cuDF API. pylibcudf Issues specific to the pylibcudf package labels Dec 3, 2024
]


cdef class BufferArrayFromVector:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can probably reuse HostBuffer from contiguous_split.pyx

@@ -577,3 +612,34 @@ cpdef memoryview write_parquet(ParquetWriterOptions options):
c_result = cpp_write_parquet(c_options)

return memoryview(HostBuffer.from_unique_ptr(move(c_result)))


cpdef BufferArrayFromVector merge_row_group_metadata(list metdata_list):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar to write_parquet, I think we want to return a memoryview here

Copy link

copy-pr-bot bot commented Dec 4, 2024

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@Matt711
Copy link
Contributor Author

Matt711 commented Dec 4, 2024

/ok to test

@Matt711
Copy link
Contributor Author

Matt711 commented Dec 4, 2024

/ok to test

@Matt711 Matt711 added the 3 - Ready for Review Ready for review by team label Dec 4, 2024
@Matt711
Copy link
Contributor Author

Matt711 commented Dec 4, 2024

/merge

@rapids-bot rapids-bot bot merged commit cd3e352 into rapidsai:branch-25.02 Dec 4, 2024
106 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team feature request New feature or request non-breaking Non-breaking change pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API.
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants