Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Option to suppress materialized view's stale check in iceberg connector #11698

Closed
ulmako opened this issue Mar 29, 2022 · 0 comments · Fixed by #15842
Closed

Add Option to suppress materialized view's stale check in iceberg connector #11698

ulmako opened this issue Mar 29, 2022 · 0 comments · Fixed by #15842
Assignees
Labels
enhancement New feature or request

Comments

@ulmako
Copy link
Contributor

ulmako commented Mar 29, 2022

As discussed with @raunaqmorarka in the this Slack Thread, materialized views on the iceberg connector save and use the snapshot-ids of the queried tables to check if the data in the storage table is up-to-date. If the data is not up-to-date the storage table is considered stale and the materialized view will query the source tables instead of the storage table.

For setups, where the tables in the source query are updated often or where the materialized view is used to increase the performance by using other partition-specs as the tables in the source query, this behavior is maybe not in the interesst of the creator (like in my case).

It therefore would be nice to have an option or table property to suppress the behavior completely or at least for a given time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

Successfully merging a pull request may close this issue.

2 participants