Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support v2 iceberg tables with gzip #8848

Merged
merged 2 commits into from
Jun 19, 2024

Conversation

jgprogramming
Copy link
Contributor

Iceberg saves metadata with "gz.metadata.json" suffix when compressed with gzip for v2 tables and with "metadata.json.gz" for v1 tables. Current implementation recognizes only v1 gz tables and fails for v2.

@CLAassistant
Copy link

CLAassistant commented Jun 17, 2024

CLA assistant check
All committers have signed the CLA.

Copy link
Member

@dimas-b dimas-b left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution @jgprogramming !

The fix LGTM in general, just a couple of minor comments.

@jgprogramming
Copy link
Contributor Author

instead of creating new test added two new cases to existing test:

  • for v1 format
  • for v2 format
  • for generic format (previous case with just .gz at the end)

Hope now it's ok, let me know what you think

Copy link
Member

@dimas-b dimas-b left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks again @jgprogramming !

The PR LGTM. @snazy WDYT?

@dimas-b dimas-b requested a review from snazy June 18, 2024 16:58
@snazy snazy merged commit 307480c into projectnessie:main Jun 19, 2024
16 checks passed
@snazy
Copy link
Member

snazy commented Jun 19, 2024

LGTM! Thanks for the contribution!

rohanag12 added a commit to rohanag12/nessie that referenced this pull request Nov 22, 2024
rohanag12 added a commit to rohanag12/nessie that referenced this pull request Nov 22, 2024
rohanag12 added a commit to rohanag12/nessie that referenced this pull request Nov 22, 2024
snazy pushed a commit that referenced this pull request Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants