Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Decimal 128 Support: Read/Write Parquet #3881

Closed
revans2 opened this issue Oct 21, 2021 · 1 comment · Fixed by #4362
Closed

[FEA] Decimal 128 Support: Read/Write Parquet #3881

revans2 opened this issue Oct 21, 2021 · 1 comment · Fixed by #4362
Assignees
@kuhushukla
Labels
cudf_dependency An issue or PR with this label depends on a new feature in cudf P0 Must have for release task Work required that improves the product but is not user facing

Comments

@revans2
Copy link
Collaborator

revans2 commented Oct 21, 2021

The outstanding PR for decimal 128 support in CUDF is still missing parquet support. That should hopefully be coming soon. This is intended to add in that support once it is merged in. Please note that this also impacts #3475 because once we can support reading decimal128 values we need to also have a way to read unsigned long values and cast them to the corresponding decimal 128 type.
@revans2 revans2 added ? - Needs Triage Need team to review and classify task Work required that improves the product but is not user facing labels Oct 21, 2021
@Salonijain27 Salonijain27 added cudf_dependency An issue or PR with this label depends on a new feature in cudf P0 Must have for release and removed ? - Needs Triage Need team to review and classify labels Oct 25, 2021
@kuhushukla kuhushukla self-assigned this Oct 27, 2021
@Salonijain27
Copy link
Contributor

rapidsai/cudf#9566 was filed by Vukasin to track the cuDF dependency

@sameerz sameerz linked a pull request Dec 15, 2021 that will close this issue
Decimal128 support for Parquet #4362
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kuhushukla kuhushukla

Labels
cudf_dependency An issue or PR with this label depends on a new feature in cudf P0 Must have for release task Work required that improves the product but is not user facing
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Decimal128 support for Parquet kuhushukla/spark-rapids
3 participants
@revans2 @kuhushukla @Salonijain27