We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug I think that https://issues.apache.org/jira/browse/SPARK-44079 did this, but I am not 100% sure it could also be related to https://issues.apache.org/jira/browse/SPARK-44940
Essentially if we try to parse a struct that has integers that overflow 3.4.2 and beyond we get back nulls for each field, which matches the plugin.
{"data": {"B": 99999999999999999999, "A": -9999999999999999999}}
Parsed as data struct<a long, b long> results in
data struct<a long, b long>
{null, null}
But before 3.4.2 we get a single null out for the entire struct
null
Ideally we would make it match whatever it is we do. Note that this is similar to #10573
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Describe the bug
I think that https://issues.apache.org/jira/browse/SPARK-44079 did this, but I am not 100% sure it could also be related to https://issues.apache.org/jira/browse/SPARK-44940
Essentially if we try to parse a struct that has integers that overflow 3.4.2 and beyond we get back nulls for each field, which matches the plugin.
Parsed as
data struct<a long, b long>
results inBut before 3.4.2 we get a single null out for the entire struct
Ideally we would make it match whatever it is we do. Note that this is similar to #10573
The text was updated successfully, but these errors were encountered: