Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extract SystemTableProvider from Hive #23380

Merged
merged 1 commit into from
Sep 12, 2024

Conversation

Dith3r
Copy link
Member

@Dith3r Dith3r commented Sep 12, 2024

Description

Allow to define system table providers for Iceberg similar to Hive.

Additional context and related issues

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Sep 12, 2024
@github-actions github-actions bot added iceberg Iceberg connector delta-lake Delta Lake connector hive Hive connector labels Sep 12, 2024
@Dith3r Dith3r requested a review from ksobolew September 12, 2024 09:10
@Dith3r Dith3r force-pushed the ke/iceberg-st branch 2 times, most recently from fc5c9b5 to 08c3d65 Compare September 12, 2024 11:28
@Dith3r
Copy link
Member Author

Dith3r commented Sep 12, 2024

CI failure: #22861

@Dith3r Dith3r closed this Sep 12, 2024
@Dith3r Dith3r reopened this Sep 12, 2024
@Dith3r Dith3r changed the title Allow to define system table providers for Iceberg Extract SystemTableProvider from Hive Sep 12, 2024
@raunaqmorarka raunaqmorarka merged commit 4f1fa43 into trinodb:master Sep 12, 2024
95 checks passed
@github-actions github-actions bot added this to the 458 milestone Sep 12, 2024
@electrum
Copy link
Member

What is the reasoning for this change? Do you have plans to use this for other connectors? If we don't have any near-term plans, then let's revert this, and it can be added when it will be used.

@electrum
Copy link
Member

Also, there is a cost to sharing code, and seemingly no benefit here. What's the usefulness in extracting an interface that will be used independently by different connectors? There is no shared implementation that would need to be fixed in multiple places. But if we need to make a change to one of the connectors but not the others, the artificial coupling here makes that change harder.

If you need a similar internal interface in another connector, simply copy the (two method) interface to the other connector.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed delta-lake Delta Lake connector hive Hive connector iceberg Iceberg connector
Development

Successfully merging this pull request may close these issues.

5 participants