Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove temporal to kernels_arrow #6069

Merged
merged 10 commits into from
Apr 24, 2023
Merged

Remove temporal to kernels_arrow #6069

merged 10 commits into from
Apr 24, 2023

Conversation

berkaysynnada
Copy link
Contributor

Which issue does this PR close?

Closes #5704.

Rationale for this change

Temporal arithmetic code will be moved to arrow-rs eventually. For this purpose, this PR is an intermediate step that facilitates the process (the same pattern used for other removals).

What changes are included in this PR?

In datetime.rs, the evaluate() function calls the binary.rs function resolve_temporal_op() and resolve_temporal_op_scalar(), according to type of the second value, Array or Scalar. It can access the add/sub_dyn...() functions in kernels_arrow.rs (the functions that will be moved to arrow-rs deployed here until arrow-rs changes happen)

Are these changes tested?

Yes, with existing tests.

Are there any user-facing changes?

@github-actions github-actions bot added the physical-expr Physical Expressions label Apr 20, 2023
@berkaysynnada
Copy link
Contributor Author

@alamb I hope it was in line with your plan to move the codes. If there are places you think would be better, I'd love to hear.

@jackwener jackwener requested a review from tustvold April 21, 2023 15:20
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @berkaysynnada -- this is definitely in the right direction.

Eventually my hope is to use the add_dyn kernels directly. This feature was added in apache/arrow-rs#4038 by @Weijun-H which will be in arrow 38 which should be landing in DataFusion sometime next week

@alamb
Copy link
Contributor

alamb commented Apr 21, 2023

Screenshot 2023-04-21 at 4 36 43 PM

@berkaysynnada can you please resolve the conflicts with this PR? I don't really understand the issue, but I suspect it will be straightforward to fix

Copy link
Member

@jackwener jackwener left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mustafasrepo mustafasrepo merged commit 655f2a8 into apache:main Apr 24, 2023
@berkaysynnada berkaysynnada deleted the feature/removal-temporal-arith-to-kernels-arrow branch April 25, 2023 08:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
physical-expr Physical Expressions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Timestamp and Interval arithmetics
6 participants