Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Iceberg optimize, allow specifying specific partition spec ids #12983

Closed
alexjo2144 opened this issue Jun 24, 2022 · 1 comment
Closed

Iceberg optimize, allow specifying specific partition spec ids #12983

alexjo2144 opened this issue Jun 24, 2022 · 1 comment
Assignees
@alexjo2144
Labels
enhancement New feature or request

Comments

@alexjo2144
Copy link
Member

Relates to: #12362

If a column belongs to multiple partitioning schemes, we currently require that all the schemes are able to enforce a predicate on the column in order to selectively run the optimize procedure. We should introduce a parameter which allows users to selectively choose which partition specs they are optimizing This way a column which was once partitioned with a bucket transform, but is now using an identity transform can still be selectively optimized.
@alexjo2144 alexjo2144 added the enhancement New feature or request label Jun 24, 2022
@alexjo2144 alexjo2144 self-assigned this Jun 24, 2022
@alexjo2144
Copy link
Member Author

After some more thought #13082 should resolve most of the use cases where we would want this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alexjo2144 alexjo2144

Labels
enhancement New feature or request
Milestone
No milestone
Development

No branches or pull requests
1 participant
@alexjo2144