-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: basic support for SQL SELECT -> ExtendedExpression #55
base: main
Are you sure you want to change the base?
Conversation
ACTION NEEDED Substrait follows the Conventional Commits The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification. |
80738d1
to
b70ef4e
Compare
I just imported this from an experiment, it's far from being done. I need to refactor and further improve it. Here is a reference to the kind of operations I'm aiming at supporting: https://arrow.apache.org/docs/python/generated/pyarrow.dataset.Expression.html#pyarrow.dataset.Expression
|
a727475
to
3c9f6eb
Compare
|
The pyarrow pull request related to this one to execute queries on arrow datasets via ExtendedExpressions was merged, so I'll try to recover work on this one as soon as I can |
This allows to compile basic SQL SELECT statements to ExtendedExpressions,
the goal is to handle pyarrow Dataset support for ExtendedExpressions
in Projections and Filtering of Datasets.
This can act as a starting for future support of more advanced features,
like subqueries and entire Substrait Plans,
for the moment the goal is just to support what pyarrow.Expressions
can represent