You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The unix_timestamp function should either return null values or throw an exception for values that cannot be parsed given the specified format (depending on the value of spark.sql.legacy.timeParserPolicy).
However, the function currently returns incorrect data.
Running on the GPU and on the CPU did not match
CPU: ArrayBuffer([31/12/1999,null], [31-12-1999,null], [12/31/1999,null], [12-31-1999,null], [1999-12-31,946598400], [1999/12/31,null])
GPU: ArrayBuffer([31/12/1999,-61206796800], [31-12-1999,-61206796800], [12/31/1999,-61806412800], [12-31-1999,-61806412800], [1999-12-31,946598400], [1999/12/31,946598400])
Expected behavior
Behavior should match Spark on CPU.
Environment details (please complete the following information)
N/A
Additional context
N/A
The text was updated successfully, but these errors were encountered:
Describe the bug
The
unix_timestamp
function should either return null values or throw an exception for values that cannot be parsed given the specified format (depending on the value ofspark.sql.legacy.timeParserPolicy
).However, the function currently returns incorrect data.
Steps/Code to reproduce bug
Expected behavior
Behavior should match Spark on CPU.
Environment details (please complete the following information)
N/A
Additional context
N/A
The text was updated successfully, but these errors were encountered: