Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature/Addition] BigQuery get_columns_list() using information schema #909

Closed
elyse-weiss opened this issue Oct 19, 2023 · 2 comments · Fixed by #911
Closed

[Feature/Addition] BigQuery get_columns_list() using information schema #909

elyse-weiss opened this issue Oct 19, 2023 · 2 comments · Fixed by #911
Assignees
Labels
enhancement Impact - something should be added to or changed about Parsons that isn't causing a current breakage

Comments

@elyse-weiss
Copy link
Contributor

A BigQuery version of Redshift.get_columns_list() leveraging the information schema to save costs.

Detailed Description

Idea here is to get same result as get_columns_list(), but without querying the table directly to save money in BigQuery!

Context

TMC leverages this function a lot in Redshift, so we'd like it in BigQuery too!

Possible Implementation

Shared above.

Priority

High

CC: @shaunagm as this may be duplicative of other issues on bringing BigQuery up to parity with Redshift

@elyse-weiss elyse-weiss added the enhancement Impact - something should be added to or changed about Parsons that isn't causing a current breakage label Oct 19, 2023
@shaunagm
Copy link
Collaborator

@IanRFerguson @KasiaHinkson @sharinetmc - is this on your radar internally, are you hoping the wider Parsons community will tackle it?

@IanRFerguson
Copy link
Contributor

@IanRFerguson @KasiaHinkson @sharinetmc - is this on your radar internally, are you hoping the wider Parsons community will tackle it?

great question Shauna, we had not discussed it! I'll go ahead and knock it out before the end of the week

@IanRFerguson IanRFerguson self-assigned this Oct 26, 2023
@IanRFerguson IanRFerguson linked a pull request Oct 26, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Impact - something should be added to or changed about Parsons that isn't causing a current breakage
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants