Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow connector to provision multiple catalogs #18339

Open
kokosing opened this issue Jul 19, 2023 · 3 comments
Open

Allow connector to provision multiple catalogs #18339

kokosing opened this issue Jul 19, 2023 · 3 comments
Labels
enhancement New feature or request

Comments

@kokosing
Copy link
Member

kokosing commented Jul 19, 2023

There are certain connectors (like JDBC connectors) that maps remote catalog to Trino catalog. In case remote data source have multiple catalogs then user needs to setup multiple catalogs in Trino too manually. Each of them would be considered from Trino engine point of view as separate and independent catalog like they were from different connectors. With this way we are losing an opportunity of optimization like join pushdown over multiple Trino catalogs but the same connector.

Having connector to provision multiple catalogs, Trino engine would be able notice such case and potentially it would possible to allow join pushdown in such case to shared connector.

CC: @wendigo @martint @findepi @hashhar

@kokosing kokosing added the enhancement New feature or request label Jul 19, 2023
@hashhar
Copy link
Member

hashhar commented Jul 19, 2023

The other benefit would be that connectors can create catalogs for each schema in the remote database. This avoids users having to provision a new catalog and restart Trino if a new schema is added in remote system without having to implement 4 part identifiers. (e.g. Redshift, BigQuery etc.)

@Praveen2112
Copy link
Member

Almost a similar issue - #1135

@huw0
Copy link
Member

huw0 commented Jun 4, 2024

This would be really useful when paired with #21791

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

No branches or pull requests

4 participants