Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store metadata when listing columns/comments in Delta Lake #23589

Merged
merged 1 commit into from
Oct 3, 2024

Conversation

ebyhr
Copy link
Member

@ebyhr ebyhr commented Sep 27, 2024

Description

Store metadata when listing columns/comments in Delta Lake

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.

@cla-bot cla-bot bot added the cla-signed label Sep 27, 2024
@github-actions github-actions bot added the delta-lake Delta Lake connector label Sep 27, 2024
@ebyhr ebyhr force-pushed the ebi/delta-store-metadata branch from 3fd0d60 to d4abb5f Compare September 27, 2024 06:28
@ebyhr ebyhr requested a review from wendigo September 27, 2024 22:38
@findinpath findinpath self-requested a review September 30, 2024 04:27
@ebyhr ebyhr force-pushed the ebi/delta-store-metadata branch from d4abb5f to 5d3f0ac Compare October 3, 2024 06:01
@@ -783,12 +826,35 @@ public void testSystemMetadataTableComments()
assertUpdate(session, "INSERT INTO test_select_s_m_t_comments" + i + " VALUES ('xyz', 12)", 1);

assertUpdate(session, "CREATE TABLE test_other_select_s_m_t_comments" + i + "(id varchar, age integer)"); // won't match the filter

if (removeCachedProperties) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It took me a bit to understand the purpose of removeCachedProperties in testSystemMetadataTableComments() method.

I understand though now the purpose - we want to verify how the system.metadata.table_comments query behaves when the table comments are added filled one by one as well as when they are added in bulk.

@ebyhr ebyhr force-pushed the ebi/delta-store-metadata branch from 5d3f0ac to e8b858a Compare October 3, 2024 09:08
@ebyhr ebyhr merged commit 6f7937c into trinodb:master Oct 3, 2024
3 of 10 checks passed
@ebyhr ebyhr deleted the ebi/delta-store-metadata branch October 3, 2024 09:08
@github-actions github-actions bot added this to the 460 milestone Oct 3, 2024
@mosabua mosabua mentioned this pull request Oct 3, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed delta-lake Delta Lake connector
Development

Successfully merging this pull request may close these issues.

4 participants