Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Add support for Struct columns in CoalesceExec #2530

Closed
gerashegalov opened this issue May 27, 2021 · 0 comments · Fixed by #2531
Closed

[FEA] Add support for Struct columns in CoalesceExec #2530

gerashegalov opened this issue May 27, 2021 · 0 comments · Fixed by #2531
Assignees
@gerashegalov
Labels
feature request New feature or request
Milestone
May 24 - Jun 4

Comments

@gerashegalov
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
I wish the RAPIDS Accelerator for Apache Spark would support structs when coalescing dataframes

Describe the solution you'd like
df.coalesce() should be executed on GPU even in presence of struct columns

Describe alternatives you've considered
CPU fallback works

Additional context
N/A
@gerashegalov gerashegalov added feature request New feature or request ? - Needs Triage Need team to review and classify labels May 27, 2021
@gerashegalov gerashegalov self-assigned this May 27, 2021
@gerashegalov gerashegalov removed the ? - Needs Triage Need team to review and classify label May 27, 2021
@gerashegalov gerashegalov added this to the May 24 - Jun 4 milestone May 27, 2021
gerashegalov added a commit to gerashegalov/spark-rapids that referenced this issue May 27, 2021
@gerashegalov
Support structs and decimals in coalesce
4bba2da 
Closes NVIDIA#2530

Signed-off-by: Gera Shegalov <[email protected]>
@gerashegalov gerashegalov mentioned this issue May 27, 2021
Merged
@jlowe jlowe mentioned this issue May 28, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gerashegalov gerashegalov

Labels
feature request New feature or request
Projects
None yet
Milestone
May 24 - Jun 4
Development

Successfully merging a pull request may close this issue.

Add nested types and decimals to CoalesceExec gerashegalov/spark-rapids
1 participant
@gerashegalov