Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test: Use BigQuery Read API for reading external BigLake tables #24452

Conversation

ebyhr
Copy link
Member

@ebyhr ebyhr commented Dec 11, 2024

marcinsbd and others added 2 commits December 11, 2024 16:45
The storage APIs support reading BigLake external tables (ie external
tables with a connection). But the current implementation uses views
which can be expensive, because it requires a query. This PR adds
support to read BigLake tables directly using the storage API.

There are no behavior changes for external tables and BQ native tables -
they use the view and storage APIs respectively.

Added a new test for BigLake tables.

Co-authored-by: Marcin Rusek <[email protected]>
@cla-bot cla-bot bot added the cla-signed label Dec 11, 2024
@github-actions github-actions bot added the bigquery BigQuery connector label Dec 11, 2024
@ebyhr ebyhr closed this Dec 12, 2024
@ebyhr ebyhr deleted the ebi/marcinsbd/use-bq-read-api-for-reading-external-bl-tables branch December 12, 2024 00:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bigquery BigQuery connector cla-signed
Development

Successfully merging this pull request may close these issues.

3 participants