Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: Switch to new multifile #20973

Closed
wants to merge 25 commits into from

Conversation

coastalwhite
Copy link
Collaborator

No description provided.

This is an drafting PR to show the idea of rewriting the predicate expression
in the planner to an expression that can be used to skip record batches (row
groups in parquet).

At the moment this is probably already close to what the existing
implementation can do even with some more to show that it is better (by
implementing `Expr.is_in`).

[skip ci]

Verified

This commit was signed with the committer’s verified signature.
OlimpiaZurek Olimpia
@github-actions github-actions bot added internal An internal refactor or improvement python Related to Python Polars rust Related to Rust Polars labels Jan 29, 2025
@kszlim
Copy link
Contributor

kszlim commented Jan 29, 2025

Haven't had time to check, but did #20853 get fixed already?

@coastalwhite
Copy link
Collaborator Author

It is not yet fixed. This PR should probably be name differently.

@coastalwhite coastalwhite deleted the refactor/new-multifile branch February 13, 2025 12:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
internal An internal refactor or improvement python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants