Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

parquet-avro 1.14 not compatible with avro 1.8 #2956

Closed
RustedBones opened this issue Jul 16, 2024 · 0 comments · Fixed by #2957
Closed

parquet-avro 1.14 not compatible with avro 1.8 #2956

RustedBones opened this issue Jul 16, 2024 · 0 comments · Fixed by #2957
Assignees
@RustedBones
Labels
Type: bug
Milestone
1.14.2

Comments

@RustedBones
Copy link
Contributor

Describe the bug, including details regarding any error messages, version, and platform.

Some changes made to parquet-avro here uses API introduced in avro 1.9.

It should be possible to keep parquet-avro compatibility with older avro version by using the schema builder api instead

Component(s)

No response
@RustedBones RustedBones mentioned this issue Jul 16, 2024
Merged
@Fokko Fokko added this to the 1.14.2 milestone Jul 17, 2024
wgtmac pushed a commit that referenced this issue Jul 24, 2024
@RustedBones
GH-2956: Use avro SchemaBuilder API to convert record (#2957)
e8bbfbb 
The avro schema builder API is cleaned and more stable. It decreases
chance of using newly introduced avro API in case user run with legacy
avro version

As OPTIONAL converted fields sets null as default, increase consistency
by using [] as default for REPEATED converted fields.
Fokko pushed a commit that referenced this issue Aug 14, 2024
@RustedBones @Fokko
GH-2956: Use avro SchemaBuilder API to convert record (#2957)
0f3a615 
The avro schema builder API is cleaned and more stable. It decreases
chance of using newly introduced avro API in case user run with legacy
avro version

As OPTIONAL converted fields sets null as default, increase consistency
by using [] as default for REPEATED converted fields.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@RustedBones RustedBones

Labels
Type: bug
Projects
None yet
Milestone
1.14.2
Development

Successfully merging a pull request may close this issue.

GH-2956: Use avro SchemaBuilder API to convert record
2 participants
@Fokko @RustedBones