You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description SPARK-40646 introduces a subtle change to how partial parse results are reported when reading JSON input. If the parse on one column fails, the column that follows is also reported as null.
We need to check whether GpuReadJsonFileFormat produces null values in the same way.
Steps/Code to reproduce bug
From the commit message, reading the following input:
Description
SPARK-40646 introduces a subtle change to how partial parse results are reported when reading JSON input. If the parse on one column fails, the column that follows is also reported as null.
We need to check whether
GpuReadJsonFileFormat
produces null values in the same way.Steps/Code to reproduce bug
From the commit message, reading the following input:
via the following schema:
produces the following result:
Expected behavior
The results should have been:
Note: This was apparently a regression introduced by SPARK-33134.
The text was updated successfully, but these errors were encountered: