Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix failure when reading non-primitive Parquet fields in Iceberg #22367

Merged
merged 1 commit into from
Jun 12, 2024

Conversation

ebyhr
Copy link
Member

@ebyhr ebyhr commented Jun 12, 2024

Description

We were getting the value from descriptorsByPath only when it's a primitive type before #19066.

Fixes #22347

Release notes

# Iceberg
* Fix failure when reading Parquet files that don't have `field-id` on structured types. ({issue}`22347`)

@cla-bot cla-bot bot added the cla-signed label Jun 12, 2024
@github-actions github-actions bot added the iceberg Iceberg connector label Jun 12, 2024
@ebyhr ebyhr marked this pull request as draft June 12, 2024 06:45
@ebyhr ebyhr force-pushed the ebi/icebeg-parquet-field-id branch from b9bf1f1 to 65b84b1 Compare June 12, 2024 06:47
@raunaqmorarka raunaqmorarka requested a review from Heltman June 12, 2024 06:51
@ebyhr ebyhr marked this pull request as ready for review June 12, 2024 07:35
@ebyhr ebyhr force-pushed the ebi/icebeg-parquet-field-id branch from 65b84b1 to 0cc9025 Compare June 12, 2024 09:09
@ebyhr ebyhr force-pushed the ebi/icebeg-parquet-field-id branch from 0cc9025 to 73e589c Compare June 12, 2024 10:18
@ebyhr ebyhr merged commit 45b1605 into trinodb:master Jun 12, 2024
43 checks passed
@ebyhr ebyhr deleted the ebi/icebeg-parquet-field-id branch June 12, 2024 21:33
@github-actions github-actions bot added this to the 450 milestone Jun 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed iceberg Iceberg connector
Development

Successfully merging this pull request may close these issues.

Iceberg query failure because of predicate pushdown with iceberg column id
5 participants